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Preface 



Identifying, measuring, and analyzing postsecondary education outcomes is 
a complex and difficult process. It has, however, become an increasingly 
important process during this last decade, as pointed out by the introductory 
chapter to this document. Therefore, this sourcebook has been designed to serve 
as a flexible and practical aid to acquiring the data necessary for obtaining a 
wide range of information about the postsecondary education outcomes occurring 
at one's institution. It does this by presenting an array of procedures that 
can br used by institutional researchers and planners to obtain local data 
for selected postsecondary education outcome measures (indicators). 

This is a revised and greatly expanded version of the NCHEMS Outcomes 
Measures and Procedures Manual that was published in 1975. That document was 
developed in two phases. Phase I concerned the identification of those outcome 
measiires most needed by postsecondary education decisionmakers. Recognizing 
that the NCHEMS constituency at that time was composed primarily of institutional 
and state- level decisionmakers, the following types of decisionmakers were 
surveyed to determine the outcome measures they believed would help provide 
the outcome information they needed for carrying out their job responsibilities. 
1. Administrators from community colleges, public and private four-year 
colleges, and public and private universities. The particular adminis- 
trators surveyed in these institutions were the president and top-level 
administrators for academic planning, student affairs, and budget and 
finance. 
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governing boards and coordinating co.ncU. 



3. State legislators who chaired leg 

education and appropriations. ^^^^^^ ^^^^^^^ ^^^^^^^^^ 
„,1,ed questionnaires were used ,n ^^^^ ^^^^^^ ^^^^^^^^ 
,„erent decisionmakers In '-^^^^ J^^,^^ j^^lMii^^ 

land «allhaus 1.3). 
2^^-^^^^^^^^^^^ operational de.1nU,ons and data acgu1s1t,on 
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force of ten diverse practitioners in ^^^^^^^^ 

- ^""^"^ ris." Which meant that officials at 
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,,,, Had agreed to review, critique. ° ^ ^ ^.^^^ ^^,ewers received 
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■ooth the OutcmMeaarSlJnlilSC,---— , validated, 

,„d comparative data gathered, by 

of California at Los Angeles). ^.^^^^ ^„ of 

colleges and universities, but also by 
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states. In addition, pilot tests of the manual were conducted during 1977-79 

by two state systems of colleges and universties and at different institutions 

in other states. Here was the major test of the feasibility and usefulness of 

various measures and the specified data acquisition procedures. Another major 

test was the manual's use in developing the NCHEhS Student Outcomes Questionnaires 

(which were subsequently revised in 1977-78 to form the basis of the NCHEMS/ 

CEEB Student Outcomes Information Services [SOIS] program) and their pilot test 
at a number of colleges and universities. 

This current version of the document is based on input from the field 
review and pilot tests, as well as review of the more recent literature and 
developmental work in the areas of community impact, research and scholarship 
outcomes, and student retention and growth. Its development has been overseen 
by two six-person advisory committees, one concerned specifically with research 
and scholarship outcomes and one with student and outcomes. In 
addition, prior to its publication, pertinent NCHEMS staff and a panel of 
several dozen selected field reviewers reviewed, critiqued, and suggested 
improvements for the document that were subsequently acted upon. 

This document covers 200 measures, more than four times the number 
of measures that were covered in the initial version. Some of them came from 
Pace's Measurement and E valuation Kit, which is out of print and probably will 
not be reprinted. Many others came from a variety of sources including the 
published research. 

A number of the additions were pilot tested, while many more have not been 
subjected to such test but rely on face validity and evidence of validity 
and reliability found by studies reported in the literature. Those measures 
that have been pilot tested through campus activities supported by NCHEMS 
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are identified in the comments section of the presentation of each measure in 
Part III. (They are also identified by asterisks in the overall listing of 
Part II.) 

The new version of this cocument is also different from the old in terms of 
its organization and the information provided for each measure. The original 
version was organized according to the way outcome types were ordered in the 
NCHEMS Inventory of Higher Educatio n Outcome Variables and Measure s, a listing 
of outcome types (with associated measures) ordered according, to the traditional 
division of higher education activities (instruction, research, and public 
service). The current document is subdivided according^to selected categories 
of the NCHEMS Outcomes Structure (Lennin^ and others 1977; Lenning 1977), 
a comprehensive and generic conceptual and organizational classification of 
potential and actual postsecondary education outcomes that was developed to 
replace the Inventory. The sections are ordered alphabetically according to the 
terms used in the Structure. In addition, general guidelines for collecting, 
processing, analyzing, and using outcomes data have been made a part of the 
body of this document. Previously such sections were included as appendixes, 
but such appendixes were apparently often not noticed by users of the document 
even though a felt need for such information existed. 

The original version of this sourcebook did not have an index. The 
current version does have an index, however, which should allow users to go 
quickly and easily to measures and topics of special interest to them. In 
addition, holes are punched inthe pages so that it can be placed in a notebook 
and helpful materials gathered locally inserted where appropriate. 

A final modification of the document that should be mentioned is the 
inclusion for each measure of some indication of the specific uses of that 
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measure at the institutional and state levels. Although the pilot test 
experiences demonstrated the usefulness of a number of specific applications 
of various measures, it should be made clear that such indications of differ- 
ential potential usefulness are based largely on logic. Such suggestions 
were reviewed and critiqued (along with this revised document) by a diverse 
group of field reviewers, but the empirical validity of mobc of these 
assertions remains to be demonstrated. It is hoped that users of this 
document will let NCHEMS know when such suggestions of applicability prove, or 
do not prove, out in practice, so that future editions of this sourcebook 
can be more reality-based. 

A common suggestion for improving the manual was to develop comparative 
statistics for the various questionnaire items suggested. Resources available 
for the redraft of this document, however, did not allow such normative 
distributions and statistics to be developed, as desirable as they would have 
been. 

As should be clear by the subtitle and what has been said thus far, this 
document is intended to serve as a helpful resource for those involved in 
administrative and policy research, planning, and evaluation at the institutional, 
consortial, and state levels. It is in particular meant to be a practical and 
flexible tool of use to those who collect or use information about educational 
outcomes, who are assisting in the design of such research and evaluation studies. 
It provides a collection of potentially useful measures, and alternative 
acquisition procedures for those measures, from which one can choose--and to which 
one can add one's own unique measures and procedures. At the institutional 
level, the personnel most likely to find this document of use are: (1) those 
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who are directors and personnel serving in offices of institutional research or 
planning, (2) academic affairs vice presidents and mid-level managers, (3) 
financial affairs vice presidents and mid-level managers, and (4) student 
affairs vice presidents and mid-level managers. At the state level, administrative 
planning and budget staff and legislative support staff should also find 
various measures that pertain to their concerns. 
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Chapter 1 
INTRODUCTION 



The activities of administrators, faculty, student affairs workers, 
and others in postsecondary education are all directed toward (some more 
directly than others) bringing about certain kinds of "educational outcomes," 
Therefore, it is only natural to wonder if those activities are bearing fruit, 
and if more effective application of them could result' in "better fruit," 
Funders and overseers of postsecondary education (including community or state 
citizens, legislators, government officials, alumni, boards of trustees, donors, 
and foundations), and institutional clients, are wondering the same thing--in 
terms of whether or not they are getting ^heir "money's worth," The increasing 
focus on such questions caused a number of people to view the 1970s as an 
"age of accountability." 

In order to evaluate educational outcomes, one needs measures and indicators 
that can provide evidence about their absence or presence, procedures for using 
them, and guidelines for applying the assessment information gathered. That 
is what this sourcebook is all about. 

This chapter discusses what is meant by the terms "educational outcomes," 
"measures," and "procedures," It also outlines the specific purposes of this 
manual, and how to use it. In addition, the limitations of the manual are 
presented. Chapter 2 provides discussions about the various administrative 
needs for outcomes information. Chapter 3 gives general procedures for collecting, 
processing, interpreting, and applyinq outcomes data. Chapter 4 provides guide- 
lines for processing and storing data. Finally, the chapters in part III give 
standard definitions, data acouisition procedures, and suggestions for 
possible use of selected measures in each of the following outcome areas: 
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community outcomes; new knowledge, technology, and art-form outcomes; student 
economic outcoiTies; student human-characteristic outcomes; and student knowledge 
and understanding outcomes. The terms for these chapter titles are from the 
NCHEMS Outcomes Structure (Lenning and others 1977; Lenning 1977), and the 
chapters are ordered alphabetically. Only a small portion of the Outcomes Structure 
categories are included in this document, so a different and much simpler 
numbering system will be used for the measures presented here." There is no 
relationship between the coding system used here. and the one used for the NCHEMS 
Outcomes Structure. 

What Do We Mean by "Educational Outcomes"? 

Postsecondary-education outcomes are the end results of the activities 
and processes that occur within postsecondary-education institutions and programs. 
As discussed by Lenning and others (1977), they can include the direct results 
of those activities and processes, plus any short- or long-term consequences of 
those end results. Thus, we are talking about chains of results or any 
particular outcome within such a chain. Outcomes can occur during the activities 
or processes causing them or helping to facilitate their occurrence, or at any 
point thereafter. Furthermore, once they occur, they may be lasting and of 
long duration or only temporary and of short duration. 

Because it may be difficult to demonstrate empirically that particular outcomes 
can be attributed to postsecondary education (for example, student outcomes may 
instead result largely from maturation, postcollege experiences, or off-campus 
activities), or to particular programs or their activities and processes within 
postsecondary education, some types of outcomes will often be spoken nf in 
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terms of being possible, potential, or intended. We can also talk about outcomes 
in terms of whether they are or are not expected to occur. While most educational 
outcomes are intended, a number clearly occur which are unintended and unexpected 
"side effects" (sometimes side effects are unintended but expected). Such 
unexpected and/or unintended outcomes can be seen as positive or negative by 
different people, and they can be major outcomes that deserve attention. 

The terms "outcomes" is generically neutral. It pertains to maiatenance 
(keeping the status quo; stabilization, reproduction, or preservation) or 
to change (alteration of the status quo; modification, .revision, or replace- 
ment) in terms of status, condition, product, event, characteristics, presence, ^ 
or occurrence. However, people attach positive, negative, or neutral value 
to educational outcomes. Some people will perceive an outcome to be func- 
tional and desirable as it pertains to a particular area, while others will 
see that some outcome as dysfunctional and not desirable or as only functional 
and desirable in other areas. 

Outcomes can be seen in terms affecting or being received by persons, 
things (such as the environment), groups, organizations, interest-based comuni- 
ties, geographic-based communities, or aggregate subclassifications of such 
entities. Lenning and associates (1977) have referred to these as the "audiences" 
for the outcomes. In this document, outcome measures for two audiences are 
emphasized: (1) the local community and (2) students. For a particular audience, 
we can speak of outcomes in terms of types: (1) economic outcomes; (2) human- 
characteristic outcomes; (3) knowledge, technology, and art-form outcomes: (4) 
rezource and service provision outcomes; and (5) other maintenance and change. The 
fifth type of outco'ne is the only one for which no measures are provided. 
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What Do We Mean by "Measures"? 

To measure means to determine or identify the presence ?,id the extent 
or amount of something, such as an outcome. Some people claim that any 
outcome can be measured, while others suppose that certain outcomes cannot be 
measured. Whichever view is held, some outcomes are clearly easier to measure- 
are more measurable-.-than others. By measurabili ty, we refer to the extent 
to which and ease with which a particular outcome can be quantified or made 
tangible, concrete, and observable. 

Evidence or an indication of the presence and amount of a particular outcome 
is embodied in what is herein referred to as a "measure." Measures can be more 
or less valid with respect to how much they pertain to the outcome of concern; 
in addition, some measures are much more reliable or dependable than others 
(concerning accuracy and consistency of what they show). Often the term measure 

has been used only in connection with measures of high reliability and validity 
(such as standardized tests), while other evidences of the presence and amount 
of an outcome have been referred to as indicators. On the other hand, "measures" 
have also been commonly used to refer to indicators also, as indicated by the 
widespread reference to terms such as "unobtrusive measures" and "proxy measures." 

As used here, "measures" is seen in the broad context. Any variable or 
factor that suggests the presence and/or amount of a particular outcome is 
viewed in this document as a measure of that outcome. Another viewpoint of this 
document is that r.ultiple measures and data sources are desirable whenever they are 
feasible in terms of cost, staff time, and ease of use. An exception would be 
where an extremely valid and reliable measure is being used. Where one measure 
may be weak (with respect to validity, reliability, and "audience" of concern). 
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another may be strong, and vice versa. Together they will usually provide a 
more valid and reliable indication about the presence and amount of a particular 
outcome, than any one of the measures by itself. If all the measures indicate 
the same thing, there is probably some assurance about the status of the outcome. 

What Do We Mean by "Procedures"? 
A procedure is a method, means, or course of action for bringing something 
about. It is information t^at tells or instructs us how to do. or accomplish 
something. For each outcorre measure included in this document, one or more 
means of obtaining data for the measure are described. Implementation of 

these procedures can allow one to acquire ^the outcome data that are reflective 

t 

of the expected outcomes of concern. 

The procedures provided in this sourcebook are of two types. In part I 
is provided a number of procedures and guidelines for collecting data in general. 
For each measure in part III, data acquisition procedures pertaining spi':ifical ly 
to each measure are provided. For a number of the measures, alternative data 
acquisition procedures are presented in order to give the users of this sourcebook 
as much flexibility as possible in acquiring the data necessary for the measure. 
For instance, procedures may differ with respect to data-collection mechanisms 
(institutional records, test instruments, questionnaire surveys^ interviews, 
and so forth) or data sources (exiting students, former students, faculty, 
administrative staff, and so forth). In cases where questionnaires or interviews 
are suggested as the data collection mechanism, specific wordings for items 
or questions to be asked are presented. 
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When a particular collection mechanism or data source is recommended, it 
is assumed that the reader knows the general implementation procedures that apply, 
either through past knowledge and experience or reading part L It should also 
be mentioned that this sourcebook has generally steered clear of recommending 
nontraditional data collection mechanisms. Persons interested in the application 
of nontraditional methods and procedures to the collection of educational outcomes 
data are referred to Lenning (forthcoming).' 

The Purpose of This Sourcebook, 
and Procedures for Using It 
Most decisionmakers concerned with pOjptsecondary education recognize the 
need for information about the outcomes (results and impacts) of institutions and 
their programs for purposes of planning, management, and evaluation and also for 
supporting and justifying long-range plans and budgets. These same decisionmakers 
are quick to point out, however, the complexities of identifying, measuring, and 
analyzing postsecondary education outcomes and of incorporating this information 
into the planning, management, and evaluation process. Although these complexities 
will continue to plague efforts to obtain and use outcome information, this 
sourcebook is intended as a step forward in dealing with them. This document 
does this by presenting an array of alternative procedures for obtainir data 
related to a variety of potential measures or indicators of the outcomes of 
postsecondary institutions and their programs that can be useful for: (1) 
educational planning, (2) institutional research, and (3) program and 
institutional evaluation. The manual provides: 
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• A list of postsecondary education outcome measures or indicators that 
have been identified as relevant to the outcome information needs of 
institutions and state-level educational decisionmakers. 

• Standard definitions of each outcome measure to facilitate communication 
among decisionmakers 

• Specific data sources and procedures that can be used for acquiring data 
related to each outcome measure presented. 

• Specific suggestions concerning who might find each measure of use and 
when (an index has been included in the back that will allow the user 
of this sourcebook to go directly to the measures perceived by its develop- 
ers to be most useful to someone in his or her position). 

It was recongized that the outcomes in which one is interested varies 
markedly from person to person, and thus the attempt was made to cover a wide 
range of outcome areas found to be important to different people. Information 
about such interests was gathered through a survey of different users conducted 
prior to beginning development of the field review edition of this document, and 
through the field review and pilot tests of the initial document. 

It was also recognized that the information about outcomes needed by different 
decisionmakers in postsecondary education varies considerably as to when it is 
needed and at what level of detail. Thus, the attempt was made to have the 
sourcebook be a flexible and adaptable tool from which users can pick and choose 
the procedures most appropriate for acquiring data related to the outcome measures 
they need and gather data at the level of detail or ajgregation that they need. 

As mentioned previously, the remaining chapters of part I provide general 
data acquisition and use guidelines. Then in part II, all of the measures contained 
in this sourcebook are outlined. Finally, in part III, ordered series of abstract 

24 
ERIC 



sheets that separately present each measure and its related procedures are 
provided. Each abstract sheet contains the following information: 

1 . The name of the outcome measure 

2. The code number used to categorize the measure 

3. A definition of the measure 

4. The data sources from which the data needed for the measure can be 
obtained 

5. A listing of the general type of procedures recommended for obtaining 
the measure 

6. Code numbers of suggested data uses (coding key is provided in Fig. 2, p. 

7. Comments that may be useful in understanding the use of the measure 
and its acquisition procedures 

A sample copy of the abstract sheet format is shown in figure 1. Following 
the one-page abstract for each measure, the data acquisition procedures suggested 
for that measure are presented. 

Using this sourcebook should be a fairly straightforward process. Figure 3 
outlines the major steps involved. The first step actually does not invlve use 
of the manual at all, but rather is prerequisite to using it-- the determination of 
outcome information requirements * There are various purposes for or reasons why 
one might be interested in collecting outcome information. Examples include the 
following (1) the need to assess the extent to which certain institutional or 
program objectives are being met, (2) the need to answer a particular question 
related to some problem that must be solved, and (3) the need to be accountable 
to some external governing or funding body, such as a board of trustees or a state 
legislative appropriations committee. In establishing the plan for collecting 
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Figure 1 

Sample of the Abstract Formats Used in Part III 



Outcome Structure Category 11.2710 



N-10 

Measure 
Number 



Measure Name 



student sta at withdrawal time 



Definition 



Characteristics of students that have withdrawn from the Institution 
before completing a program- 



f 



Data Sources 



Exiting Students, Former Students 



Procedures 



Administration of a survey questionnaire, exit interviews, search of 
institutional records. 



Uses 



Institutional 



State 



Comments [ ~ " * " 

This measure has been pilot tested. 

The purpose of the measure is to describe relevant characteristics of 
students who withdraw from the Institution prior to completion of a program. 
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Figure 2 

POTENTIAL USES OF POSTSECONDARY EDUCATION fNFORf^TION 

A. ACCOUNTABILITY 

1. Evaluating institutional and program efficiency and effectiveness 

2. Evaluating innovations 

3. Faculty and staff evaluation 

B. INFORMATION PROVISION A^'D COMMUNICATION 

1. Stimulation of faculty, staff, student and community discussion 

2. Recruitment and retention 

3. Public and alumni relations 

C. GRADING, PROMOTION AND MERIT AWARDS. 

D. PLANNING ^ 

1. identification and assessment of student and community educational needs 

2. Institutional and program mission, goals, and objectives formulation 

3. Decision? about market position, segmentation, and program development 

4. Resource and process planning 

5. Program and curriculum development 

6. Program, course, student life, and faculty life improvement 

7. Planning learning experience? 

E. Pc_ICY FORMULATION 

F. RESOURCE ACQUISITION 

G. RESEARCH 

H. STUDENT ASSISTANCE 

1. Counseling and advising 

2. Diagnosing student problems 

3. Appraising student readiness 

4. Student placement 

5. Job placement 

6. Keeping aware of student complaints and concerns, and responding to them 



\ 
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Figure 3 

The Major Steps Invo.ved in Using This Sourcebook 



PREREQUISITE: 

Determination of outcome 
information requirements 



Determine which outcome information 
requirements can be satisfied by 
measures contained in Sourcebook 



I 



For each required outcome measure, 
select the most appropriate data 
acquisition procedures from those 
available in the Sourcebook and 
modify as desired, or develop one's 
own. 



Integrate Sourcebook data acquisition 
procedures into an overall data 
collection plan 



Implement outcomes data collection 
plan 



i 



REMAINING STEPS: 

Analysis of data 
Utilization of information 
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the outcome information, the design of the study required by the questions or 
hypotheses of interest needs to be developed, the sampling procedures need to 
be determined, and thfi variables to be measured need to be identified. 

It is important that the determination of measures come out of the questions 
and problem of concern. Sometimes it can be helpful to look at a universe of 
possible measures, however, and pick and choose. Part II provides such a list. 
Even more helpful might be to use the index of this document and look up the 
category that comes closest to the problem and situation of concern. It is 
important not to limit consideration of measures- to only ones that are in this 
book, however, it was not intended that this document be all-inclusive. Once a 
person gets started, other measures especially appropriate to the situation are 
likely to come to mind. Getting one's logic and the "creative juices" started 
is the most difficult task for many people, and it is hoped that this document 
can provide some stimulation for th^s. 

Once the outcome information requirements have been identified, the user 
can begin determining explicitly which outcome measures included in the manual 
will help in satisfying the outcome information requirement. Even if tha 
manual was used to stimulate brainstorming in the manner outlined above, each 
of the measures identified there should be carefully considered in the light of 
its definition. 

For each of the outcome measures that help satisfy the outcome information 
reqi'irements, the user should assess the appropriateness of the data acquisition 
procedures recommended in the manual. In some instances, the user will have 
to chojse between alternative data collection procedures for an individual measure. 
While adaptations of the procedures will need to be made for the unique purposes 
of each study, users' experience suggests that only minimal modifications are 
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often necessary. For soine studies and situations, however, replacements with 
one's own design is advisable. 

In using this sourcebook, it is important to note that the data acquisition 
procedures presented involve the use of survey questionnaires, interviews, 
and institutional records. Because it was anticipated that survey question- 
naires and interviews will be employed quite frequently, guidelines for develop- 
ing, administering, and processing survey questionna'i v.o and conducting inter- 
views are presented in chapters 3 and 4 of part I of this manual (pages OO-OO), 

Although the outcome measures and associated data acquisition procedures 
are presented individually in the manual, prospective us^ers will most likely 
use combinations of these measures and procedures because of their wide range 
of outcome information needs. Thus, the final major step in using the manual is 
to integrate the selected procedures into the established overall information 
collection plan. This may include developing an exiting student questionnaire, 
a follow-up questionnaire for former students, a community input survey question- 
naire, a fac'jlty activity questionnaire, and so forth. Once this is done, 
the user can implement the data acquisition procedures according to the overall 
plan. 

Limitations of the Sourcebook 
As wici any document of this type, certain limitations are present. The 
most important limitations of this version of Postsecondary Education Outcome 
Measures and Procedures are as follows: 

1. Some educators feel strongly that breaking the whole picture, such as 
overall student development into parts or components (such as different 
kinds of cognitive, affective, and psychomotor development in the case 
of student outcomes) distorts the total picture— the whole is more 
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than the sum of the parts. That this is true cannot be denied, 
but the only way we can analyze and communicate accurately, con- 
cretely and meaningfully about such overall or "whole picture" 
development is in terms of its parts, as inadequate as they may be. 

2. The initial version of this source book included only quantitative 
types of measures, which are helpful and can imply meaning if 

they are interpreted in context and seen as giving only a distorted 
view of the outcomes actually occurring (not the precision often 
implied by specific numbers). The number of quantitative nieasures 
has been increased in this area, but an attempt has also been made 
to include a number of qualitati^^e measures that in spite of their 
relative imprecision (the state of the art in qualitative measures 
is still lacking) may be fully as useful and meaningful. 

3. The outcome measures included in this manual represent only a 
subset of all the potentially useful measures of postsecondary educa 
tion outcomes. Measures that are included, however, are believed to 
be important and relevant ones for each area. 

4. The measures and acquisition procedures presented in this manual 
generate only outcome information. Although outcome information is 
basic to effective planning, management, and evaluation, it is 
important to point out that information about the resources, environ 
ments, and processes associated with the institution, program, or 
organizational unit in focus also is necessary for describing and 
explaining the outcomes of those entities. 
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5. Only those outcomes that are measurable or observable, that is, 
quantifiable outcomes, are included in the manual. 

6. The uses suggested for measures are primarily logically based, 
although the pilot testing and the literature did provide support 
for a nunter of them. 

7. The data acquisition procedures in the manual deal primarily with 
institutionally-collected information. Modifications probably will 
be necessary if the procedures are to be used by persons who are not 
institutionally based, such as state-le-vel educational planners and 
decisionmakers. 



.17- 

32 



Chapter 2 

ADMINISTRATIVE NEED FOR OUTCOMES INFORMATIG.^l 



As mentioned in the introduction, educational outcomes are what postsecondary 
education is all about. All colleges and universities exist, and were funded, 
to bring about desirable educational outcomes for their students, the local 
community, and the institutions, agencies, and citizens of society at large. 
Although certain outcomes such as knowledge and understanding are valued by all, 
however, the outcomes valued vary from one individual and institution to another. 
Similarly, subjective perceptions of what is happening with respect to educational 
outcomes will vary markedly from person to person and group to group, depending 
on their background experiences, characteristics, values, biases, perceptiveness, 
and vantage point. For these reasons and others, valid, reliable, and objective 
information about an educational institution's and program's outcomes is needed. 
Such information can serve a number of useful administrative purposes. 

Its Use in Institutional and Program 
Planning, Management, and Evaluation 
Figure 3 presents graphically a necessarily over-simple and too linear 
view of planning, management, and evaluation; but one which is adequate for the 
purpose of this section. This framework can apply either at the system, institutional, 
or program level. However, the planning, implementation, and evaluation procedures 
will vary according to the level of focus, which means that the level of focus 
must be kept clear. In fact, inappropriate planning anddata collection have in 
many cases been undertaken because the level of focus (unit of analysis) was not 
adequately defined in advance. For example, assessment of the outcomes of 
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Figure 3 

ONE WAY OF VIEWING PLANNING, MANAGEMENT, AND EVALUATION 
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(Planned 
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Course of 
Action 
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Objectives 
(Outcome 
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Outcome 
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and Tools 
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PLANNING 



Implement 
Selected Course 
of Action 



I 



Apply 
Outcome 
Measures 
and Tools 



Assess 
Actual Outcomes^ 
and Compare with, 
Planned 



Utilize 
Evaluative 
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MANAGEMENT 
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particular degree programs is impossible unless data are collected in such a way 
as to permit their disaggregation below the level of the total institution. 

Constituent needs are usually spoken of in outcome terms, as a discrepancy 
between what is desired and what is actually the case. Most needs assess- 
ment models that have been developed focus on outcomes information of that type. 
Once the constituent needs have been identified and assessed, this information 
is related to (1) evaluative information of what is currently .occurring in 
terms of outcomes and (2) the mission of and values within the unit under 
focus (system, institution, or program). Through such a synthesis and analysis, 
goals ere established. Goals provide general information about intended out- 
comes, which is then transformed into detailed, concrete information about 
planned outcomes (outcome objectives). ^ 

Next, the range of alternative courses of action (alternative activities) 
that the unit in focus might undertake to achieve the desired outcomes is 
delineated. Included in the identification of the feasible alternatives is 
the definition of a set of expected outcomes associated with each alternative 
being considered. 

The distinction make in the planning, management, and evaluation cycle 
between desired outcomes and expected outcomes is an important one. It is 
intended to make planners focus on what outcomes can realistically be expected 
from a particular alternative. Too often, planners identify the outcomes that 
are desired , but never adjust their expectations after selecting a given 
alternative, which may be designed to produce only part of the desired outcomes 
because of such factors as resource and environmental constraints. 

Once the expected outcomes of each alternative under consideration and the 
desired outcomes identified in the objective-setting step are determined, they 
become input to the activity (course of action) selection step of the cycle. 
In the activity selection step, the set of desired outcomes and the set of expected 
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outcomes associated with each alternative are compared to one another so that a 
decision can be made about which alternative will produce the results and impacts 
that most -^losely match the desired outcomes . In practice, however, the activity 
selection decision also must take into account resources and other constraints. 
Therefore, the expected outcomes of an alternative are likely to be somewhat less 
ambitious than the desir e d outcomes . 

Once the decision has been made concerning the alternative to be implemented, 
it becomes possible to determine specific outcome and related data (resource, 
process, and environmental data) requirements that will be necessary to assess 
the extent to which the expected outcomes of the selected alternative are 
accomplished. Resource, process, and envi|ronmental data are necessary because 
outcome data considered in isolation from these mitigating factors may have 
very little meaning or utility for planning, management, and evaluation purposes.^ 

The management phase of the cycle represents the actual implementation of the 
selected alternative. At the same time, the process of collecting the outcomes 
and related data should be undertaken. It is at this point that this sourcebook 
can play an important role since it provides procedures for acquiring the outcomes^ 
data that are reflective of the expected and other outcomes . 

After the outcome and related data have been collected, they can be analyzed 
for purposes of assessing and understanding the actual outcomes that result 
from the alternative that was implemented. Interest here may center on simple 
descriptions of the outcomes that result or may concern an explanation of why 
certain outcomes occurred or didn't occur. Another desirable analytic activity 



NCHEMS Technical Report 35, Program Measures (Topping and Miyataki 1973), 
can be helpful in identifying the other kinds of data that might be appropriate 
for interpreting the outcome data that will be collected. 
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would be a comparison of the actual outcomes with both the desired and the 
expected outcomes identified earlier. Analysis also may be directed toward 
prediction of possible future institutional or program performance, and what 
improvements in the system can be made and how. 

Finally, the information that results from the analysis is used as feedback 
for future planning activities. This aspect of the process is extremely important. 
Unless the results of the evaluative phase are incorporated into the next cycle, 
the outcomes data collected often will have served no real purpose. 

As inferred previously, the planning, management, and evaluation cycle 
presented here is conceptual and not operational. Furthermore, viewing the cycle 
as a strictly sequential process is unrealistic. In practice, it is often 
necessary to retrace and redo certain steps on the basis of experience later in 
the cycle. Thus, for example, the objective-setting step may cause some rethinking 
of the general goals identified earlier in the planning phase. 

There are many types of decisions within the management phase that can be 
also helped by outcomes information and these should be mentioned. One 
example concerns ongoing operational decisions related to advising and helping 
individual students and improving student retention. Another example concerns 
ongoing, operational attempts to improve student life and the campus environment; 
through responding effectively to what Baird (1976) has called "brass tacks." 
A third example concerns formulation of day-to-day operational policies. 

Its Use in Communicating with Students and Prospective Students 
A number of studies conducted during this decade have found that the information 
that institutions provide to prospective students has often been inadequate or not 
even provided to them. One of these studies was a large-scale effort conducted 
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by NCHEMS (Lenning and Cooper 1978), and it determined that this finding pertained 
to the area of outcomes information more than the others. On the other hand, 
this questionnaire survey and interviews reveal6d that students (and other such 
as high school counselors and parents) considered outcomes information extremely 
important. More outcome-related information items were mentioned as important 
than for any other information area. 

Enrolled stude;its also undoubtedly need accurate information about outcomes 
pertaining to their achievements and progress. Such data can serve important 
motivational purposes, as well as assist them in their ongoing educational and 
career planning. 

The NCHEMS study referred to above also explored how data can be formatted 
for effective presentation to students. Tabulations were generally the most 
helpful and script paragraphs (the form usually relied on almost entirely) the 
least helpful. Furthermore, prospective students usually did not understand 
some of the terms that we in higher education take for granted, such as "program" 
and "credit hour." Thus, in addition to naking appropriate and meaningful outcomes 
information available to prospective and enrolled students, care must be taken 
to conmiunicate such information effectively so that it will reach and be paid 
attention to by them, and so that it will be timely and meaningful to them. 



Its Use in Communicating with the Community and Various Publics 
A number of professionals in postsecondary education have called the decade 
of the seventies the "age of accountability," and with the large decline in the 
pool of traditional college students scheduled for the 1980s such an emphasis 
will undoubtedly continue on into the foreseeable future. Thus the book by Bird 
(1976 ) that called higher education into question was a sensation. Demands 
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for accountability are demands for information that documents the benefits 
received and the college's effectiveness in bringing about outcomes; but the 
focus is also fully on efficiency and productivity (the relationship of out- 
comes to the resources expended). Students and the various other clientele and 
funders of postsecondary education are especially concerned about what they 
are getting for their money in a time when the costs per student are rising 
rapidly and the perceived benefits of attending college are decreasing. Illus- 
trative of the thinking in the minds of many citizens during the 1970s was 
noted economist Milton Friedman's (1977) observation that the total professional 
staff in elementary and secondary schools went up 8 percent during the previous 
five years, with per-pupil cost going up percent in dollars and 21 percent 
after correction for inflation, at the same time that tie number of schools and 
students both decreased by 4 percent. Then he referred to the decrease in SAT 
scores that continued through the 1970s and concluded that the quality of 
schooling went down even more drastically than the quantity. His conclusion was 
that the productivity of elementary and secondary schools had decreased greatly 
over the previous five years. The same things will be said about postsecondary 
education during the 1980s unless colleges start doing a better job of document- 
ing outcomes and costs and communicate about these two variables and their 
relationships effectively. 

Its Use at the System and State Level 
The uses of outcomes information at the system and state level are generally 
the same as the uses for individual institutions outlined above, except those 
uses pertaining to assisting individual students. There is the matter of data 
aggregation, however, and indexes appropriate only for use at the system level. 
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Different types of outcomes data collection and analysis will often be needed 
at the state or system level, however. Furthermore, there are additional 
problems such as gaining institutional cooperation in the collection of 
assessment data. 
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Chapter 3 

DEVELOPING AND CONDUCTING 
INTERVIEW AND QUESTIONNAIRE SURVEYS 

Data acquisition procedures and sources are suggested for each of the 
measures presented in this source book. In most cases alternate procedures 
and sources are identified, and where feasioie in terms of staff time and 
resources it .is often good ^specially if one is not fully confident about the 
reliability and validity of any of tha procedures and sources for a particular 
measure of concern) to have multiple data from different sources for the 
same measure. Multiple data that indicate the same outcome give added 
assurance (in terms of increased validity and reliability) that the outcome 
has in fact occurred or not occurred. On the other hand, collecting outcomes 
data does take time and nioney, so one must pick and choose measures end data 
collection sources and procedures carefully and be realistic in terms of 
whether the pccential benefits from the data are worth the costs of the collection. 

The validity and reliability of certain data proposed for different 
measures are predetermined, such as data collected with standardized instru- 
ments (following the instructions provided) and data from student, institutional, 
or cormunity records. For locally developed instruments and procedures, 
however, the validity and reliability can vary greatly depending on the care 
taken in developing them. The two most common locally developed data acquisi- 
tion procedures suggested are questionnaires and interviews, and items for the 
measure that can be included in an interview or questionnaire (along with items 
for other measuies) are specified. Those items can be used verbatim or modified 
as desired or dictated by the situation. 

>^ 
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Because of the need to develop and use interview or questionnaire survt>s 
for acquiring as wide a range of information about the outcomes of post- 
secondary, as proposed in this source book, this chapter was included. Those 
desiring to develop such surveys who are not experienced in survey development, 
or who feel the need for a review of good practice in this area, should find 
this chapter helpful-. It is suggested that those who are experienced and 
knowledgeable about all aspects of interview and questionnaire development 
should skip this chapter . 

The purpose of this chapter is to provide a' brief overview of the major 
steps to be taken In any interview or questionnaire survey effort, and to 
review some of the key questions that must be considered at each step. 
Incorporated into the discussion are some "how to do it" suggestions regard- 
ing such things as survey design, interview development, questionnaire con- 
struction, anr" report writing. It should be noted at the outset, however, 
that in no way does this chapter cover all of the things there are to know 
about survey development and implementation. Rather it is intended to serve as 
a reminder of the minimum requirements that are paramount in any survey effort. 
Anyone desiring a more in depth treatment of any aspect of survey development 
and implementation should see the list of selected references at the end of 
this chapter. 

In some cases it may be felt, concerning the collection of data from 
students, that students are being *'ir 'iewed and questionnai red to death." 
When this is the case, non-traditional ways of collecting the data can often 
be used. A large variety of such nontraditional methods for collecting student 
outcome^ data, that have been found r^fective and feasible for certain situations 
and kinds of data are reviewed in a forthcoming NCHEMS publication. Student 
Outcomes Assessment Handbook . 

43 
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Major Steps and Key Questions 

Step 1: Establishing the Purpose of the Survey 

As defined by A. N. Oppenheim (1973) a survey is a planned data collection 
effort for the purpose of description or prediction as a guioe to action or 
for the purpose of explaining the relationships between two or more variables, 
e,g,, the relationship between student acc^demic achievement and student per- 
formance on a job. While most survey researchers wilV attest that in practice 
there are as many purposes as there are surveys,- they also will agree that fore- 
most in any survey effort is the development of a clear definition and under- 
starring of the objectives of the survey- To achieve th'is end, it is essential 
that the first step to be taken in a survp is the delineation and clarifica- 
tion of the specific problems to be studied, the critical questions to be 
answered, and the possible uses to be made of the survey results. The reason 
this step is so central to every survey i the fact that once this initial 
step is accomplished, all of the remaining steps in the survey process are 
"means to an end*' and will flow logically froni the purpose of the study 
identified in this step. 

In establishing the purpose of the surve:*, it is important to obtain input 
from those persons who will use the findings from the study. Of course, the 
larger the group of persons from which input is sought, the greater will be 
the diversity of what may constitute the objectives of the study. Generally, 
the more objectives a study has to accomplish, the greater its complexity and 
cost. Therefore, it may be cntical to set priorities as to the objectives 
that will be most important to achieve, given certain time and monetary 
constraints. 



lERLC 



■ 29- 

44 



In addition to identifying the specific purposes or objectives of 
the survey in this initial step, two other key questions should be considered: 

• What concepts need to be defined bef ore the^ suryeyjprvicess^ 

In the formulation of any survey effort, certain concepts are used 
to communicate and organize one's thinking relative to the problems 
or questions in focus. For example, in a survey of former students 
one question of interest might concern their satisfaction with their 
vocational preparation. What is meant by the concepts, "satisfaction" 
and "vocational preparation," in this context needs to be translated 
into specific terms so everyone- clearly understands what constitutes 
the acceptable indicators of these^^ concepts • 

• What assumptions will be made? 

In many surveys it is impossible to control all elements of the 
survey, e.g., the validity of certain parts of a questionnaire or 
interviewer the adequacy of the respondent sample. Therefore, 
formulating the assumptions of a survey is an important consideration 
since they may affect the survey process as well as the interpretation 
of the survey results. 
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Step 2: Developing the Survey Plan 

Generally ^.peaking, there are four basic purposes of which a survey is 

carried out: 

1 , To describe something, 

2, To expl ain something, 

3, To predict something, or 

4, To explore something. 
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Very often surveys are designed to meet more than one of these objectives. 
For example, it is not uncommon to conduct a follow-up study of college 
graduates to obtain information about their current level of educational 
attainment and occupational status (i.e., description) and their educational 
needs now that they have left the institution (i.e., exploration). Once 
the purposes of the. survey have been clearly delineated, the next key step is 
to develop the plan of action for conducting the study. The most appropriate 
is the one that ensures a logically tight and efficient plan so that clear 
answers to the questions or hypotheses of interest can be obtained. 

In developing the survey plan the following key questions need to be 
considered: 

• What will be the "units of analysis" under study? 

One of the first questions in laying the plans to be followed in 
a survey is to determine the "things" under study in the survey. 
Babbie in his book. Survey Research Methods (1973), has referred 
to the things under study in a given survey as the "units of 
analysis." The primary reason it is so important to identify the 
different units of analysis in a survey is that data will need to 
be collected to provide information about each unit of analysis 
identified. For example, a follow-up study of former students 
(graduates and nongraduates) might be aimed at acquiring information 
about (1) the marital status of the former students, (2) the salary 
level of former students who are heads of households, and (3) the mean 
annual combined income of former students' families. In these 
examples, the units of analysis would be, respectively, individual 
former students, former students who are heads of households, and 
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former students' families. As Babbie (1974: 61) points out, 

Whatever the nature of the data used to describe the 
units of analysis, it is important that they be identified 
in advance. Otherwise the sample design and the data 
collection methods may prohibit the analysis appropriate to the 
study. 

• What types of survey design will be needed? 

Having determined the purposes and the units of analysis for 
the study, the next key concern is selecting the design for the 
study. The best design is the one that arranges the conditions for 
data collection and analysis in such a way to "combine relevance to 
the research purpose with econony in procedures" (Selltiz, Jahoda, 
et al , 1951). As a result, survey designs will differ depending on 
the purposes of the study and the time and monetary constraints. 

In determing the best design for a given survey, three basic 
types of design can be considered: 

1. A Cross-Sectional Design— a plan for collecting data at 
a given point in time to describe, explain, predict, or 
explore certain aspects or relationships about a larger 
population at that point in time. 

2. A Longitudinal Design— a plan for collecting and analyzing 
data over multiple points in time to describe, explain, 
predict, or explore changes in a given population over 
time. 

3. Combination Design— in this plan, data are collected on a 
broad range of variables to provide cross-sectional baseline 
data for the incoming population of students (for example. 
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freshmen) and selected longitudinal data are collected for 
a smaller sample periodically over the duration of the 
period of concern (for example, from entrance at freshmen 
to graduation or dropout). Furthermore, at the end of the 
period the new incoming population of students is assessed in 
a cross-sectional manner so that adjustments can be made for 
any influencing societal change occurring during the period. 
There are variations to both of these basic designs that can be 
considered. For instance in a longitudinal study, a decision might 
have to be made about whether to study the same s'ample of a given 
group of students over time or to stucly different samples of a 
given group of students over time. The references presented at the 
end of this appendix under the heading "Study Designs" provide extensive 
discussion about the strengths and weaknesses of different design 
al ternati ves. 
• Should a sample be drawn? 

A survey sample represents a subgroup of elements (e.g., a small 
group of students) that has been selected from a larger population 
(e.g., all the students enrolled in the college) for the purpose 
of finding out something about the population from which they have 
been taken. Most survey efforts in postsecondary education require 
some type of sampling. The reasons for this are threefold. Probably 
the most obvious reason is that it is less expensive to survey a 
sample of a large population. A second reason for sampling is that 
it saves a great deal of time in terms of data collection and data 
processing. The final major reason for sampling is that it is 
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usually more efficient than a survey of the entire population since 
it allows for the development of higher quality instruments and 
the data collected are more manageable. 
• What kind of sample should be selected? 

Basically, two types of samples can be considered: (1) probability 
samples and (2) nonprobability samples. The important difference 
between these two types of samples is that probability samples are 
based on the use of random sampling in the selection of elements 
from the larger population. 

In choosing between these -two basic types of sampling approaches, 

one needs to assess the advantages and disadvantages of each. 

f 

Probability samples are intended to avoid biases in the selection 
of the elements of the population by making sur? all elements have 
an equal chance of selection. Such a guarantee allows the researcher 
to assume that the sample will closely resemble the population. A 
second advantage of probability samples is that they permit estimates 
of sampling error. Nonprobability samples, on the other hand, are 
apropos when probability sampling is too expensive or when it is 
impossible to apply the random selection process because the 
elements of the population cannot be enumerated. 

Some important varieties of probability samples include simple 
random samples, stratified random samples, and cluste samples. 
Variations in nonprobability samples include quota samples and 
purposive samples. Detailed discussion about these sampling 
alternatives can be found in the references suggested under the 
heading "Survey Sampling" at the end of this appendix. 
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• How large should survey samples be ? 

While the size of a sample(s) depends on a number of factors, 

generally it should be large enough to obtain a sufficient number 

of responses to make some reliable conclusions. According to 

Kish (1965:217): 

Exact control of sample size is unnecessary and impossible 
in most situations. It' may be too difficult to obtain either 
the information or procedures for firmly controlling even 
the initial sample size. Moreover, nonresponses and subclasses 
introduce additional sources of variation. We should aim at 
an approximate control that is both feasible and desirable. 
The degree of control depends on the situation, • . 

Because the answer to this key question depends on the situation at 

hand, any further discussion here may be more confusing than helpful. 

As a result, one should consult the selected references on Sampling 

Methods presented at the end of this appendix. 

Step 3: Developing the Survey Questionnaires 

Because the use of self-report survey questionnaires is suggested so often 
througout Sections II, III, and IV of the manual as the best means for 
collecting many of the outcomes measures listed therein, the following dis- 
cussion focuses on key questions related to the development of this type of 
data-gathering instrument. 

• How should the questionnaire be designed ? 

The format of any questionnaire should be attractive to the 
respondents. This is a most important ingredient in achieving a high 
response rate. 

The following is a list of suggestions for making a questionnaire 
attracti ve: 
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1. Keep the questionnaire as brief as possible.* 

2. Use quality paper and printing whenever possible. 
Make sure the printing is not too small for the 
respondent to read. 

3. Design the cover of the questionnaire so that it is 
distinctive, aesthetically appealing, and simple to read. 

4. Make it easy for the respondents to record their answers. 

5. Have a logical and easily followed order and organization 
of questions. For example, provide clear instructions 
when subsequent questions are contingent on an earlier 
question(s). 

6. Present the questions so that plenty of "white space" 
shows between the items (don't clutter the questionnaire). 

A final point to be considered in questionnaire design is how the 
questionnaire will be coded once it is returned. For example, if 
the responses are to be keypunched directly from the questionnaire, 
the developer will need to make sure the keypuncher can easily and 
reliably recognize the number or alphabetic character assigned to 
the questionnaire items and their associated response options. 



*In a situation where the number of questions to be asked of respondents is 
lengthy, one may want to consider giving parts of the questionnaire to different 
samples of the same population in order to keep reasonable the length of the 
questionnaire that anyone has to answer. A term that has been assigned to 
such a procedure is "matrix sampling." 
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(A good rule to follow is have the draft of the questionnaire 

reviewed by a data processing expert to make sure it can be 

efficiently and accurately keypunched.) 
• Should open-ended or closed-ended items be used ? 

The decision about whether or not to use an open-ended item (in 
which the respondent supplies his or her own answer), a closed- 
ended item (in which the respondent selects his* or her'answers 
from the list supplied by the investigator), or both types will 
depend on the type that best serves the purpose(s) one has in mind. 
Whitney (1972) has listed the following advantages for each type of 
item. 

f 

The advantages of open-ended items are that they: 

1. Are subject to little influence of the investigator. 

2. Elicit a wide variety of responses. 

3. Are useful for introducing subjects of new parts of the 
questionnaire. 

4. Provide background for interpreting results. 

5. Give respondents a chance to "have their say." 

6. Are more "courteous." 

7. Can aid in drafting questions and coding responses 
(when used in pilot work). 

8. Give "sparkle" and credibility to your final report. 

On the other hand, the advantages of closed-ended items are 
that they: 

1. Are interpreted more uniformly by respondents. 

2. Produce easily tabulated responses. 

3. Are unaffected by the respondent's verbosity. 




4. Eliminate some problems of vocabulary and definitions. 

5. Allow more questions to be asked. 
• How should q^uestionnaire items be worded ? 

The wording of questionnaire items is extremely important to ensure 
that the respondents will be willing to and capable of answering them 
in an honest and accurate way. This means that the i terras must be 
clear and unambiguous so the respondents understand exactly what the 
investigator wants to know. To achieve this objective, the following 
points should be considered: 

1. To the extent possible, items should be kept 'short. Items 
that are too long often will cause the respondent to forget 
the purpose of the questions in focus. Further, lengthy items 
can cause fatigue and impatience among respondents which, in 
turn, may affect questionnaire reliability and response rate. 

2. In writing the items, keep the language simple, clear, and 
straightforward. A good rule to follow is write the item 

so that the respondent feels you are treating him or her with 
respect and courtesy. 

3. To the extent possible, items should be stated in the form of 
simple sentences rather than in the form of compound or complex 
sentences . 

4. Caution should be taken to avoid biased words or phrases that 
may influence a respondent to answer one way or another. 

5. If questionnaire items offer alternative responses to be 
checked by the respondent, the set of responses should include 
all possible and distinct responses to the question in focus 
to avoid confusion (i.e., the set of responses should be 
exhaustive and mucually exclusive). 
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6. The need tc avoid "double-barreled" questions is another 
I important consideration in item wording. For example, 

■ asking respondents to agree to disagree with statements 

such as "Micro University should continue to strive for 

I excellence in the liberal arts and excellence in its career- 

oriented -programs" should be avoided. Some persons may not 
I be able to respond because they might favor an emphasis in 

_ the liberal arts curriculum but be violently opposed to any 

* career-oriented curricula or vice versa. Furthermore, if they 

I did answer, the responses of such persons would be misleading. 

Babbie (1973: 142) suggests that whenever the word "and" 
I appears in a questionnaire item, the item should be checked 

to determine if it is a double-barreled one. 

■ In developing the questionnaire items included in the Outcome 

■ Measures and Procedures Manual , these guidelines have been taken into 
consideration. However, as modifications are made to these items 

■ or new questions are added, the guidelines pertaining to question 

'^'ng should be reviewed. 

■ • How should the items be sequenced? 

■ Thu sequence in which questions appear on a questionnaire is always 
significant since it not only adds to the attractiveness of the 

■ instrument but also sets the tone for responding to the questionnaire. 
As a general rule of thumb it is suggested that a questionnaire 

I should begin with a set of questions that will be most interesting 

■ to the respondent. That is, they should make the respondent want 

to answer them. Often questions concerning attitudes and satisfaction 
I can serve this purpose, while questions regarding demograpl. ,c 

variable will not. 
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A second rule to follow in the sequencing of items is to group 
the items that deal with the same topic* For example, on a former 
student questionnaire, questions concerning educational progress 
and plans could be one grouping and questipns about occupatioral 
status and plans could be another grouping. 

A final consideration concerning item sequencing is that some 
people feel that items which are more difficult to answer should 
be toward the end of the questionnaire unless they are crucial 
for setting the tone or introducing the substance of the questionnaire. 
• What kinds o^ instructions should be included in the questionnaire ? 

The instructions contained ir>jfa questionnaire are especially 
important for di*'*3Cting the respondent through the body of the 
questionnaire and for establishing and maintaining rapport with the 
respondent. Instructions within the questionnaire also will help 
the respondent understand the purpose of the order of questions 
and make more sense out of the questionnaire as a whole. For example, 
in introducing a series of questions that are designed to determine 
students' job career plans, it can be beneficial to preface the series 
with the statement: 

"The following four questions are intended to help us learn 

about your current and long-range occupational career plans 

and activities." 



*After this rule has been considered, it ^ht be good also to group 
according to item format type, e.g., all l.ms on a particular topic 
that are "sentence-completion" shoulo je grouped together. 
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• What kind of introductory cover letter should accompany the questionnai re? 

The letter that accompanies the questionnaire is also important 
for establishing rapport since it serves to introduce the total survey 
and its purpose. Very often the introductory letter is the key 
device that motivates the respondent to complete the questionnaire. 
Generally, the more personal you can niake the cover letter, the 
greater will be your chances of achieving a high response rate. 

• What pilot testing of the questionn^aire will be conducted ? 

Ideally, a pilot test (preliminary tryout) of the total survey 
should be conducted. Such a pilot test would include testing thr, 
sample design, the questionnaire, the data gathering and processing 
procedures, and the data analysis to be carried out. At a minimurr., 
a pilot tes. of the questionnaire to be used in the study should be 
conducted. Furthermore, the pilot version of the questionnaire should 
be to the extent pjssible an exact replica of the questionnaire that 
is intended for the actual study. If a final version of the question- 
naire has not been decided on, then alternative questionnaires should 
be tried out on different pilot samples. In this way, pilot test 
respondents will be reacting to the version that is likely to become 
the final instrument. 

Step 4: Collecting and Processing the Survr ^ Data 

This major steo involves the administration (assembly and'distribution) 
of the questionnaires and what should be done with them once they are returned. 
Key questions associated with this step are the following: 
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• How will the questionnaire and its accompanying materials be 
assembled and distributed ? 

In conducting a self- report questionnaire survey, special attention 
must be given to the distribution and collection of the questionnaires 
for the purpose of ensurng a high response rate. The method for 
administering a questionnaire that most often is employed involves 
the asserrbly of (1) the questionnaire, (2) an introductory letter, 
and (3) a return postage-paid envelope. An alternative method is 
the development of a self-mailing questionnaire that requires no return 
envelope. This type of questionnaire is constructed in such a way 
that the return address and postage are printed on the questionnaire, 
and, therefore, the respondent can return it without the use of an 
envelope. (See alternative #3 for Outcome Measure 1-8 in Section IV 
of this ».:anual for an example of this latter alternative.) 

A major drawback of this latter method is that it may place too 
much responsibility on the respondent who may not be willing to spend 
a great deal of time in preparing the questionnaire for its return 
(e.g., using a stapler to seal the questionnaire). Also, special 
post office requirements concerning the size and form of materials 
that can be mailed may cause unforeseen problems. Possibly the best 
suggestion that can be given is that no matter which method is used, 
you should assess what approach will be most acceptable to the respon- 
dents and also will meet the requirements of the postal authorities. 

It should be noted that for surveys of current students and faculty/ 
stafr, non-mail methods may be appropriate for distributing self-report 
questionnaires. For example, questionnaires can be administered to 
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faculty at faculty meetings, to current students at the end of a 
I class or in their living units, and to graduating students when they 

— register for graduation. The major advantage of this method is that 

• it offers greater control over questionnaire response rate and allows 

■ for oral clarifying information to be provided to the respondents. A 
problem can arise with this method if the respondents feel they are 

I being hurried or imposed upon. Therefore, it is important to be sure 

the respondents do not feel they are being forced in any way to 
W complete the questionnaire. 

■ • How will the returned questionnaires be monitored ? 

The monitoring of returned questionnaires is another major concern 
I in carrying out a survey since it sets the stage for data processing 

and, subsequently, data analysis. The following strategy has been 

■ suggested by Babbie (1973) for dealing with this issue: 

im First, prepare two return-rate tables. The first table should 

identify the number of questionnaires returned each day from 

■ Day 1 (the date the questionnaires are mailed) to the day 

that is the designated cutoff date for returned questionnaires. 
I The second tible should identify the cumulative number or 

p percentage of the questionnaires that were returned. Again, 

start with the day the questionnaires were mailed as Day 1 and 
I end with the designated cutoff date for the returned question- 

naires. The advantages of these \.vo tables are that (a) they 
I allow you to keep track of response rate to the mailed question- 

^ naires, (b) they provide ready-made tables that could be included 

■ in the study report, and (c) they identify the size of the follow-up 

■ mailing that will be necessary. 
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Once the two return- rate tables have been prepared, assign 
identification nufrbers to each of the questionnaires as they 
are returned. These identification numbers should be assigned 
serially. Such numbers can be valuable in est^imating non- 
response biases in the survey. Babbie (1973) presented the 
following example to illustrate the utility of using these 
numbers: 

If grade-point average (GPA) reported jy students 
decrease steadily through the data collection, with 
those replying right away having higher GPA's and those 
replying later having lower GPA's, then the research 
might tentatively conclude that those who failed to 
answer at all have lower GPA's yet. 

In giving this example Babbie cautions, "While it would not be 

advisable to make statistical estimates of bias in this fashion, 

the researcher could take advantage of approximate estimates." 

• What follow-up procedure needs to be used ^ 

Everything that has been suggested up to now concerning the 

development and administration of survey questionnaires has focused on 

the objective to obtain an acceptable response rate. However, almost 

every survey, no matter how carefully it has been planned and the materials 

have been developed, needs a follow-up design. The primary reason for 

this is that a high response rate ensure? that the sample of actual 

respondents approximates the larger population and, therefore, valid 

conclusions can be made about the findings. 

Generally, the follow-up design will call for the use of (1) a 

reminder letter or postcard, (2) a follow-up letter and a questionnaire, 

(3) a telephone follow-up, or (4) combinations of these three techniques. 
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The exact follow-up procedure selected will depend on the situation 
at hand. However, several general suggestions are important to 
keep in mind: 

1. Make sure the follow-up is properly timed. Usually, there is a 
two week interval between the initial contact and the follow-up 
contact. - 

2. Make sure the nonrespondents can be identified at each stage of 
the follow-up. One way that has been found useful in keeping 
track of nonrespondents in mail surveys is to produce three sets 
of stick-on address labels. The first set can be used for the 
first mailing. When questionnaires are returned, the address 
label for the respondent can be removed from the second set of 
labels and placed on the questionnaire for identification purposes. 

Then when the follow-up mailing is scheduled, the remaining labels of the 
second set can be used to address the envelopes or postcards. The 
third set is then used to identify those who return questionnaires 
after the follow-up mailing and those who do not. 

3. Develop a return- rate graph to assess the effects of the initial 
contact and subsequent follow-up contacts. 
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• What will be an acceptable response rale? 
As njentioned above, an acceptable response rate is important so valid 
conclusions can be made about the results. In mail surveys related 
to postsecondary education, response rates vary from 30 to 80 percent 
depending on the type of respondents. For example, a much lower response 
rate can be expected in dropout studies than in other kinds of outcome 
studies. 
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A common procedure for computing the response rate is as 
f ol 1 ows : 

1. Identify the initial size of the sample. 

2. Subtract the number of persons in the initial sample who did not 
receive questionnaires from the total number of persons in the 
initial sample. 

3. Divide the number of persons who returned completed questionnaires 
by the net number who received questionnaires. The percentage that 
is obtained identifies how successful -the survey was in getting 
people to participate. 

For those persons who did not respond it is always a good idea 
to check if there was a response bias (i.e., to determine if only a 
certain type of person responded or did not respond). 
• How should the data be Pi^ocessed? 

This question focuses on how the data will be coded, edited, 
formatted, and eventually stored (filed). Because of the importance 
of these considerations a^id the confusion that often surrounds them, 
a detailed discussion of a set of rules in this area is presented in 
Appendix E. 



Step 5: Analyzing the Survey Data 

This step is designed to determine what the data collected in the survey 
actually mean. The following two kpy questions need to be considered in this 
step: 

f What statistical techniques are needed to^ analyze the data? 

The overall purpose of statistical analysis is to link the 
data back to the questions or hypotheses that motivated the study in 
the first place. In analyzing survey data, two basic types of 
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statistical treatments of the dat? can be enfiployed: (1) descriptive 
statistics and (2) inferential statistics. Descriptive statistics 
are appropriate when there is an interest in an accurate description 
or picture of the data. Generally, three methods can be used to 
achieve this objeccive: 

1. Description of the distribution of the data through the 
use of frequency distributions and percentages. 

2. Description of the central tendency of the data through 
the use of means, medians, and modes. 

3. Description of the variability of the data through the 

use of standard deviations and Ranges between the data. 

I 

Inferential statistics should be applied when the questions or 
hypotheses of the study call for dr wing inferences or testing con- 
clusions, or generalizing about the data. According to Hillway (1969) 
inferential statistics are intended to answer questions like the 
following: 

- What is the probable accuracy (i.e., reliability) of the 
measurements? 

- To what extent does the situation described by the 
data differ from what might be arrived at through 
mere chance? 

- To what extent is there a relationship between two or mre 
factors or variables dealt with in the study? 

Useful guides for selecting the appropriate statistical methods 
to be applied in a study have been prroared by Tatsuoka and Tiedeman in 
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Gage's Handbook of Research on Teaching (1963) and by Siege! 
in his book on Nonparametric Statistics for the Behavioral Sciences 
(1966). 

• Will a statistical computer program be used to analyze^the data? 
A variety of statistical computer program packages have been 
developed to aid researchers in the analysis of large amounts of data. 
Three of the more well-known statistical packages used 'in analyzing 
survey- type data are: 

L SPSS—Statistical Package for the Social Sciences by N- H, Nie, 

D. H. Bent, and C. H. Hull McGraw-Hi 1 1 Book Co,, New York, 1975, 
2. BMD— Biomedical Computer Programs by W- J. Dixon (EdJ, University 

of California Press, Berkeley, 1973, 
3- OSIRIS III by Survey Research Center ISR, University of Michigan, 
Ann Arbor, 1973. 
When considering the use of these statistical packages it is 
important to keep in mind: (1) their ease of use, (2) their availa- 
bility to the researcher, and (3) the availability of the specific 
statistical analytic techniques in the statistical package. 



Step 6: Reporting the Survey Results 

This step is intended to help cominunicate the survey findings in a logical, 
clear, and accurate form. In short, it is the step in which the data are 
finally prepared in a form that ''hey can be used in the decisionmaking process. 
Key questions to be considered in ch.s step include the following: 
• Who will read and use the report ? 

Having a clear understanding of who will read the survey report is 
extremely important for effectively communicating the results rf the 
study. Very often different audiences will be interested in the findings. 



As a result, drafts of the survey report will have to be appropriate 
for different levels of interest in the report and different levels 
of sophistication among the various readers. 

• Will there be more than one report ? 

In many cases cx variety of reports will be deve'loped that vary in 
form (oral and written) and length. For example, a lengthy written 
report that describes the study procedures followed and presents the 
finding in detail will probably need to be prepared for the sponsor 
of the research. Often a shorter, more compact version of the full 
report will be needed to summarize the study and its findings for 
those persons who do not have time to read the full report and who are 
less interested in the various nuances and details of the study.* This 
shorter version of the report will quite often be more widely read and 
quoted. Therefore, it is important to select carefully the critical 
aspects of the study to be communicated in the report and to do so in a 
form that is attractive and easy to understand. 

• What tables, charts, and figures will be most useful in communicating 
the results of the study ? 

Much thought should be given to how the data and results of the 
statistical analysis will be communicated in the reports. In choosing 
the types of tables, charts, graphs, and so forth to be used, it is 
a good idea to consider how familiar the audience is with statistical 



*For survey findings to have maximum impact, it will also be desirable to 
prepare even shorter special reports for groups of decisionmakers having 
different concerns. The reports prepared for p=»cticular decisionmakers 
should focus only on those findsings of importance to them. 
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concepts and presentations. Also it is good to remember that 
"a picture is worth a thousand words" if it is a good one. (A good 
reference on characteristics of tables, charts, and figures can be 
found on pages 38-53 of Glass and Stanley's book. Statistical Methods 
in Education and Psychology , 1970,) 
• When will the report be nteded? 

Although* this is the last key question presented in this chapter, 
it is equally, if not more, important than all the other questions. 
Survey efforts are usually undertaken in postsecondary education 
institutions to provide information for decisionmaking purposes. 
As a result, if the report is not available when it is needed, then 
all the time and energy that has been put into it has gone for 
naught. For this reason, it is important in planning the survey 
to develop an activity-time flow chart that specifies when each 
milestone has to be met. 

A Final Comment 

Obviously, the discussion presented in this chapter provides only a 
thumbnail sketch of the major steps and key questions to be considered in the 
questionnaire survey process. It is hoped, however, that comments and sug- 
gestions which have been made about these steps and questions will serve as a 
set of minimum guidelines for ensuring the appropriate and useful application 
of " .e data collection procedures presented in this manual. 

To aid in further inquiry about the various components of the survey 
process mentioned in this appendix, a set of selected references follows. 
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Chapter 4 

DATA PROCESSING GUIDELINES: 
CODING, FORMATTING, EDITING, DOCUMENTING, AND STORING DATA 

As indicated in chapter 3, even those designing a study who will not be 
involved in processing the data will need to consider data processing needs 
carefully in their design of (1) the questions to be 'spoken io by the 
study, (2) the sampling plan and procedures, (3). the data collection and 
recording instruments, and (4) the analyses to be specified. It is important for 
study designers to have some understanding of data processing concepts, needs, and 
capabilities even when data processing experts are available to provide consul- 
tative input. The study planner's study design must be communicated to the data 
processing expert in a way that the expert can relate his/her processing knowledge 
and skills to the study most effectively and efficiently. In return, the study 
planner must be able to understanding study-related problems being communicated 
by the consultant. 

In many cases, even in large institutions, those designing stud^'es will also 
be the ones who plan, coordinate, and carry out the data processing activities. 
The need for such a person to have an understanding of data processing concepts, 
procedures, and guidelines should be apparent. One would be surprised at how 
may times one who decides to conduct an administrative study lacks data processing 
knowledge, either through lack of training and experience or because former 
knowledge has been forgotten through lack of use. There have been numerous 
instances where persons have conducted hand tabulations and analyses--even though 
computer processing would have saved much time, effort, and expense--solely 
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because they knew little or nothing about data processing, were afraid to ask 
for assistance from available others having such knowledge, or did not know 
whom to ask for help. 

Because of the aforementioned needs held by many who conduct the type of 
research that this sourcebook is intended to assist, data processing concepts 
and guidelines are presented in this chapter. Even those completely uninitiated 
to data processing should be able to gain enough of an understanding that they 
can comnunicate effectively with a processing consultant, find meaning in the 
instructional materials for "canned" computer programs such as Statistical 
Program for the Social Sciences (SPSS), and prepare data for simple computer 
analysis. Of course, those proficient ii^data processing should bypass this 
chapter . 
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Overview 



Most data collection efforts proceed through several major stages: a 
design or planning phase, a collection or implementation phase, an analysis 
phase, and, finally, a report-writing phase. Frequently, little attention is 
paid to the development of sensible coding and data formatting rules. It is 
the contention here that a considerable amount of money and effort could be 
saved on many data collection projects by the application of a few common- 
sense rules or guidelines for transcribing the data from raw response form to 
computer-readable cards, tape, or disc. 

The intent of this chapter is to provide some rules or guidelines for 
those involved in the processing of data in preparation for computer analysis. 
(Some of the rules relate primarily to the problems associated with survey or 
questionnaire data, but most are simply standard, common-sense procedures 
applicable to the processing of any input documents.) Throughout the chapter, 
several central themes are expressed: 

• The loss of information should be minimized between the raw document 
and the computerized form of the document 

• Errors in transcribing the data should be minimized 

• The programmer's problems in working with the data should be minimized 
(This does not mean that the number of programs should necessarily 

be minimized, but that decoding, subscripting, formatting, and other 
data-handling problems should be kept to a minimum.) 

• The number of decisions by coders and keypunchers should be minimized, 
that is, any data manipulation that can be done on the computer should 
not be done by hand 
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This chapter is not intended as a guide to good survey design, although 
many of the suggestions given here are related to the design of ques c.onnaires 
and interview instrumert design, and should be taken ">nto account when planning 
the instrument. Neither is this chapter concerned explicitly with data analysis, 
though again, there should be an interaction oetween data analysis and data 
transcription considerations. 

There are numerous examples of time and money lost because of poor coding 
schemes, both in very large data collection efforts and in small, one-person 
efforts. The guidelines which follow are an attempt to present some common- 
sense rules to use ""^n coding data, deciding on a format for the data, and 
editing, storing, and documenting the data for further use. Adherence to these 
guidelines should ensure that the data will never have to be repunched and that 
what i_s punched will be a complete and accurate representation of the raw data. 

The remainder of this chapter is organized into six sections: (1) 
important terms; (2) coding guidelines; (3) data formatting guidelines; (4) 
keypunching and editing guidelines (5) documentation and data storage guide- 
lines, and (6) summary. Within the last five sections, a number of rules are 
included for ensuring proper data transcription. Each rule is accompanied by 
a rationale explaining its purpose. Where appropriate, examples are included and 
in some cases, exceptions to the rule. The rules, and the pages to go to for 
an explanation of specific rule, are listed belcw: 
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CODING DATA 



Rule 
Rule 
Rule 
Rule 
Rule 
Rule 
Rule 
Rule 
Rule 



Zero as a Code 

Numeric Rather than Alphabetic Codes 

Missing Data 

Punctuation as Codes 

Categorizing Data 



C^ 'stent Codes 

Coues for Ordered Responses 

Consecutive Codes 

Standard Codes 



FORMATTING DATA 
Rule 10 
Rule 11 
Rule 12 
Rule 13 
Rule 14 
Rule 15 



ID Numbers and Card Sequence Numbers . . . 
Format Location of Frequently Used Variables, 

Organization of Fornrat . . . . • 

Multiple Cards 

Separating Variables with Blank Columns . . 
Multiple Responses 



KEYPL\OING AND EDITING DATA 



Rule 16 
Rule 17 
Rule 18 
Rule 19 
Rule 20 
Rule 21 
R'jle 22 
Rule 23 
Rule ?4 



Verifying Cards n 

Keypuncher and Coder Instructions 

Looking Over the Returned Questionnaires . 
Discussing Format and Coding with DP Person 

General Data Editing 

Editing Variables 

Right and Left Justifying . . 

Zero-fill when Keypunchino 

Printed Listing of the Data 



DOCUMENTING AND STORING DATA 

Rule 25: Written Documentation of Deci<^'^Gn:> 
Rule 26: Duplicate Copies of the Data . . 
Rule 27: Documenting Data for Storage . . 

SUMMARY (including list of all rules) 



GLOSSARY 
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Important Terms 



Since this chapter is written specifically for those inexperienced in 
processing data, certain terms important for developing an understanding of 
data processing are presented in this section. These terms will be used, or 
an understanding of them assumed, in the data processing rules and regulations 
presented in tne remaining sections of this chapter. 



ERIC 
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^ Alphabetic Codes - Codes that contain any letters from the alphabet or punc- 

• tuation (except the decimal point or plus or minus signs). 

Alphanumeric Codes - Codes that contain alphabetic characters, numeric 

■ characters, and/or punctuation. 

• Blank - Code used to indicate missing data; a blank card column is one that 
I contains no punch. 

I Card - A data storage medium; each card contains 80 columns. 

Card Number - Code used when there is more than one card per respondent to 

■ indicate the sequence of cards within ID numbers. 

m Categorical Variable - A variable wh^ich has discrete responses; i.e., the response 

■ can be placed in one of several categories; e.g., curriculum is a categorical 
variable which might have two responses: academic and nonacademic. 

Character - One numeric digit, alphabetic character, or punctuation mark. 

■ Code - The numeric (or occasionally alphabetic) representation of responses; e.g., 

the codes for male and female might be designated as "1" and "2", respectively. 

Coder - The person who examines documents, assigning codes to responses where 

■ necessary, before documents are keypunched. 



Column - One of 80 positions on a card. Also means one H,oition on the data 
format for cards, tape, or disk. 

Continuous Variable - A variable which can take on any value within a 

specified range; e.g. annual sdUry is a continuous variable that can 
take on values from zero to infinity (theoretically). 



Data Field - See field. 



Data Set - See file. 

Disk - A data storage medium, similar to tape in terms of usage. 

Editing - The process of checking coded data on cards, tape, or disk against 
the raw data (e.g., questionnaire) to correct errors that occurred 
during transcription. 

Execution of a Program - The actual running cf a program through the computer 

Field - The columns allocated on the data format to one variable; e.g., the 
ID number might occupy four columns: tnese four columns are referred to 
as the ID field. 



File - Any set of computerized data that logically belongs together; e.g., 
all the punched cards from a questionnaire administration might be 
called a file. 
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Listing - A computer-produced paper copy of the data- 

Missing data - Responses left blank by the questionnaire respondent, or 
data which are unobtainable. 

Numeric Codes - Codes which contain only numbers (the digits zero to nine) 
with or without a decimal point or a sign (pliis or minus). 

Output - The results obtained from the running of a program. 

Package Program - Any of a number of ; y;iously written computer programs 
available to perform data analysis and manipulation. 

Print-out - Output on paper. 

Punch - The square holes on a computer card designating numeric and 
alphabetic codes in each column of the card. 

Record - The set of data fields connected physically (all fields on one card) 
or logically (all fields for one respondent). 

Response - The answer given to an item or the information recorded for a 

particular variable; e.g., a questionnaire item that asks, "What Is your 
sex?" has two possible responses: male and female. 
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Format - A written description of all variables in a da'ta record, their 
location (colfjmn positions), and code-^ for categorical variables or 
ranges for continuous variables, 

ID Number - The unique identifying number for every respondent for which 
there is a card or data record. 

Item - One question on a survey or questionnaire; 

Job - A computer run. See execution of a program. 

H 

Keypunch - The machine that punches cards for computer Input or the process 
of punching data onto cards. 

Keytape - A keypunch-like machine that produces computerized data on tapes 
instead of cards. 

Leading Zeroes - Zeroes punched in the left-most columns of a numeric 

field when the datum to be punched does not fill the entire field; e.g., 
ID number one punched as '*0001" has three leading zeroes. 

Lay-out - See format. 

Left-justify - Punched data beginning in the left-most column of the field; 
e.g., the name "JONES" in an eight column field, left-justified, is 
punched "JONESbbb," where "b" means a blank column. Left-justification 
is used for alphanumeric data. 

Q -CO- 
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Sequence number - See card number. 



Subscript - A number associated with a categorical variable that designates 
response codes; e.g., the variable 'sex of respondent' might have 
responses designated and S^^ to indicate male and female. 

Tape - A data storage mriium for the computer. 

Transgeneration - The process of converting one type of 'code to another; 
e.g., (a) the continuous variable, salary, night be transgenerated 
so that there are three salary categories: high, medium, and low; 
(b) a variable coded as "1", "2", "3" might be transgenerated so that 
the codes are "3", "1", and "2", respectively. 

Verification - The process of checking punched cards (or tape) for accuracy. 
Sight verification is done by hand and machine verification is done by 
the keypuncher with a special verifying keypunch. 

Zero-fill - An instruction to the coder or keypuncher that leading or trailing 
zeroes are to be punched or coded . numeric fields. 
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Guidelines for Coding Data 

1. Rule: Do not assign a code of zero to responses, particularly 

categorical responses (see two exceptions balow). 

Rationale: Many computer languages cannot distinguish between zeroes 
and blanks; thus, special machine language programs may 
be required for this purpose. Also, package programs 
(e.g., SPSS, BMD) frequently have been written to accept 
categorical data input as Integers beginning with "1". 
Finally, most computer languages do not allow a subscript 
of zero; thus, the programmer must remember to add "one" 
to all categorical variables that can have a value of 
zero before using the variable as a subscript 

Example: The two responses YES/NO should be coded 1 = Yes and 2 = No 

or vice versa, not 0 = Yes, 1 = No. 



Assign a value of zero to a continuous variable tfiat has 
a natural zero point (I.e., the number zero indicates the 
absence of any quantity of the variable). An example of 
a questionnaire item for which a code of zero makes sense 
is the number of visits to a doctor in the past week. The 
other exception to Rule 1 is in scoring tests with right 
and wrong answers. Traditionally a wrong answer is coded 
zero and a correct answer coded as a "V\ though there is 
no compelling reason for this coding scheme. 



Exceptions: 
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2. Rule: 



Assign numeric codes to categories; do not use alphabetic 
codes to indicate responses to variables. 



Rationale: Computers operate on numbers: any alphabetic codes must 
first be translated into numbers before being tabulated, 
used as subscripts, or arithmetically manipulated. It is easier 
and less costly in the long run to have numbers translated 
into the alphabetic code they represent (when necessary 
for labelling purposes) than to translate alphabetic 
codes into numeric ^odes. 



Example: The two responses YES/NO should be coded 1 = Yes and 

2 = No, not Y = Yes and N = No. 

Exceptions: Information for printing, labelling, or addressing purposes 
sucH as name of respondent, address, etc., can and should 
be stored as alphanumeric characters. A variable such as 
home state of respondent should be punched as a number if 
any tabulations will be performed using that variable 
for grouping purposes. 

Rule: Missing data values (the response left blank) should be 

coded as blanks (the card left blank in appropriate columns). 
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Rationale: Most packaged programs are designed to eliminate missing 
data (coded as blanks) from computations at the option 
of the user. The use of a missing value code other than 
a blank will require extra cards or statements in running 
these programs. It also makes good sense to try to code 
the data for computer usage exactly like the original 
raw data as much ai: pos-sible, ' * 

Example: A missing achievement test score for a student respondent 

should be left blank on the appropriate card or tape 
columns; the card colipns should not be filled with zeroes 
or some other missing value code such as 999. 

4. Rule: Don't punch or code decimal points (or other punctuation 

such as "$", commas, etc.). 

This rule has a number of justifications: (a) 
computers do not use punctuation (except the decimal 
point) such as or commas; therefore, extra programming 
is required if any pur .uation is punched; (b) decimal 
points are acceptable as computer input but not required; 
since decimal points take up extra space on the card, 
require extra time to punch, and can be indicated easily 
at the time cf execution of the program, it Is not 
recommended that they be punched. Also, it sometimes is 
necessary to move the decimal point in a number for 



Rationale: 
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■ analysis in a particular program (If the program has a 

■ maximum or minimum range for variables); this can easily 

be accomplished if the decimal is not punched, but 

1 requires a special data transgeneration step if the 

decimal has been punched. 

■ Example: Data such as 98.112, 31.006 should be coded and punched as 

98112, 31006. Data such as $21,340.31 should be punched 
I simply as 2134031 . . " 

* 5. Rule: Don*t change uncategorized data into categories, combine 

■ one or more responses into one code, or collapse categories 

of responses into smaller number of categories at the 

I time of coding or punching. 

Rationale: It is not difficult in a computer program combine or 
9 aggregate responses from cards or tapes. It can be costly 

and time consuming, however, for a future user of the data 

■ or the current user lo decide that the unaggregated or 

■ uncombined responses are necessary to analyze the data 

properly and, therefore, have to recode and repunch some of 

I the data. There is also a greater possibility of error In 

the punched cards or tape if a coder or keypuncher is asked 

■ to mentally combine or transcribe responses while recording 

■ or punching them. 

I -C5- ' 
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Example: A questionnaire item with the fourth and fifth responjes 

listed as "not applicable" and "don't know," respectively, 
should be coded separately as "4" and "5", even if the 
current analysis plans are to combine the two responses. 
Another example is an item that asks for the respondent's 
annual salary. Even if it is planned that only three 
categories of salary will be used for analysis (e.g., 
high, middle, and low), the original salary or categories 
of salary should be coded and punched. 

6. Rule: Use i ^..tical codes for all items in a questionnaire with 

the same responses. 

Rationale: It will be easier for all persons working with the data to 
remember the numeric codes for responses if there is unifor- 
mity throughout the questionnaire or document to be punched. 

Throughout the questionnaire or document, code Yes/No as 
1 = Y, 2 = N (or vice versa, although 1 = Y, 2 = N is 
probably easier to remember). This rule applies particu- 
larly when most items on a questionnaire list "yes" as 
the first response, followed by "no", but a few items 
list these two responses in reverse order. The rule also 
applies in the case where some of the items have an 
additional category such as "don't know" which should be 
assigned a code value of "3", even though "don't knov" may 
be listed as the first response. 
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Example: 
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I Exceptions: If a questionnaire contains several Yes/No responses and 

m some 1te;ns with an additional category such as "uncertain," 

that logically falls between "yes" and "no", It Is better 
I to code 1 = Y, 2 = U, 3 = N. The rationale for this 

exception is that the response "uncertain" Is logically 
m between the responses "yes" and "no" on a scale of how 

■ certain the respondent Is about the question asked. This 

exception does not Imply that other items in the question- 

■ naire or document with only two responses (YES/NO) 

should then be coded 1 = Y, 3 = N-(see rule 8). As 1s 

■ explained In the next rule, it is important that numeric 

H 

■ codes correspond to any underlying scale in the responses. 

I 7. Rule: Numeric codes for categorical responses should correspond 

^ to Implicit ordering of the responses. 

■ Rationale: Frequently, statistics such as the mean and standard 

deviation are required for categorical variables that have 
I some underlying continuum. If the numeric codes for the 

m categories have been assigned and punched logically (i.e., 

according to the implicit ordering of the responses), no 
I recoding will be necessary to compute such statistics. 

It is also eas'er to rerr?inber the meaning of numeric codes 
I for categories if they have been assigned according to a 

a logical ordering scheme. 
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Responses to en item on a questionnaire might b? (a) high, 
(b) low, and (c) in-between. According to rule seven, 
th^ numeric cooes assigned should be Low = 1, In-I ^tween = 2 
and High = 3. Thus, the low category is assigned a low 
number, and also the assigned nunbers correspond to the 
implicit ranking of the categories. 

If the questionnaire has been written as described in the 
above example, neither the coder nor the keypuncher should 
be asked to perform the rearrangement of the codes to 

correspond to the implicit ranking of the categories; 

a 

rather, a simple transgeneration computer program should 
be r'un tc assign the number codes to the proper responses. 
The coder or keypuncher should simply code or punch 
1 = high, 2 = low, and 3 = in-between so .hat transcription 
errors will be minimized. 

Code values assigned to response categories should be 
consecutive integers ranging from *'V' to K, where K is 
the number of categories. 

For most computing purooses, computations, cost, time, and 
confusion will be minimized by assigning/ consecutive intege 
values to ca.egoif^ical responses. See also the rationale fo 
rul J 2. 
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Examole: 



For a questionnaire Item with three possible responses: 
(a) never, (b) three times a week, and (c) six times a 
week, assign codes of one, two, and three rather than zero, 
three, and six to the responses. 



9. Rule: 



Where possible, assign standard codes to questionnaire 
responses. 



Rationale: 



The use of standard cedes .(where "they exist) will facilitate 
any comparisons between the analytic results of the CU' .-ent 
study with past and future studies using the same data items 



Example: 



A data item for which numeric codes are needed might be the 
state in which the respondent lives. Clearly, every data 
collection effort in which this information Is gathered 
could assign codes from one to 51 to the various states In 
the United States, but a more sensible approach is for all 
data collectors to use the same codes. Thus, one should 
search through previous literature or other sources to 
find an existing coding system for states in the U. S. 
Other examples are the coding of occupation, education, 
ethnic group, college major field, etc. 
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Guidelines for Formatting Data 



10. Rule: Always assign a numeric Identifica Jon (ID) number and 

sequence number to every card in the data set so that each 
card has a unique number identifying its sequence. 

Rationale: There are several reasons for this rule: (a) if the cards 
get dropped, or out of sequence, ID numbers and cara 
sequenc numbers on each card make -it easy to put the 
cards back in their proper order; (b) For some purpose, 
it may be necessary to create a file of, say, the fifth 
card for each respondent; (c) Supplementary data may need 
to be merged with each respondent's previous data. 

Example: A questionnaire administered to 1300 respondents might 

require 149 card columns to punch all the responses. Four- 
digit ID numbers should assigned tc all persons and 
punched on all cards, and (since two cards will be required 
per respondent) card numbers (one and two) should be assigned 
and punched on each card. Thus, the card sequences should 
look like: 10011, 10012, 10021, 10022, etc. 



Note: (a) ID numbers ire often assigned beginning wivh lO"" 1001, 

rather than 001, 0001, etc. This practice is generally a 
good one in that it sometimes requires extr", programminq 
effort to print ID numbers with leading zeroes (i.e , "001" 
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will usually be printed as '*1" by the computer). Key- 
punchers, al:o, must be instructed to punch leading 
zeroes. Beginning the ID numbers with a "1" eliminates 
this problem, (b) It is generally a good idea to include 
a sequence number in the format, even if there is only one 
card per respondent, to facilitate adding additional cards 
for each respondent '\r\ the future, 

11. Rule: The ID number should be the first set of data on each 

card, followed by card or sequence numbers (within ID 
numbers), followed by frequently used respondent Informa- 
tion, with data responses appearing last on the card(s). 

Rationale: .nis rule is based partly on tradition and partly on 
experience. Since the ID number and card numbers are 
frequi .tly used pieces of information, placing them first 
on each card saves time for the data user or programmer. 
The same reasoning follows for such information as sex, 
ethnic origin, curriculum, grade level, and other common 
grouping variables. If a number of computer runs are to be 
made, particularly on lengthy data records (several cards 
per respondent), it is easier for everyone involved In the 
analysis or programming to look for commonly used Informa- 
tion on the first card, rather than having to find respondent's 
sex on card two in column 59 and respondent's grade level on 
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card five, column 31, etc. Hopefully, the questionnaire or 
data gathering Instrument has also been organized with 
i.Tiportant categorical variables listed first. 



Note: As in the note with rule 7, if the questionnaire has not 

been organized as described in this rule, do not ask the 
coder or keypuncher to perform the rearranging of the 
data. A separate program shbuld be run after the key- 
punching stage to accomplish this. 

12. Rule: The data iFormat or lay-out should be organized in the 

ii 

same order as the questionnaire responses except where a 
conflict exists with rule 11. 

Rationale: If the punched data format is in the same order as the raw 
data, it will facilitate the process of referring back and 
forth between the data gathering instrument and the data 
format. 

Example: The format for a questionnaire with three part^ should be 

arranged so that responses to the three sections are in 
the same ordp^ in both. Responses should also be in the 
same order on both documents within sections of the 
questionnaire. 
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Exceptions: Rule 11 should supercede this rule where there is a 

conflict between the two guidelines; i.e., if the question 
naire has been arranged such that certain important 
grouping variables (such as sex of respondent, grade 
level, etc.) are buried in the middle of the questionnaire 
it is better to place them toward the beginning of the 
format, out of the order in which they were placed on the 
questionnaire. 

Rule: A data field, such as card sequence number or ID number^ 

which appears on every card per respondei. : should be 
located in the same columns on each card. 



Rationale: A data field, such as ID number or card number, that must 
be examined across cards (either by hand, using the cerd 
sorter, or in a program), is extremely difficult tu work 
with or use if it is not punched in the same columns on 
every card. 



Example: If the ID number on card one is 1332 in columns one 

through four, then card two should also contain the ID 
number in columns one through four and similarly for the 
card sequence number in column five of both cards; e.g., 
columns 1-5 of card 1 should contain 13321, and card 2, 
1 3322. 
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14. Rule: 



In general, card columns should be filled, starting with 
column one, without spaces (blank columns) between the 
variables . 



Rationale: This rule is more of a guideline than a rule, and the user 
must decide whether to follow it or not. There are two 
reasons for following this rule: (a) inserting extra 
blank columns between variables may mean that more cards 
per respondent are necessary than the minimum required by con- 
tiguous, consecutive data. (This situation is particularly a 
problem if two cards per respondent are required rather 
than just one, since one card per respondent is much 
easier to deal with than two or more.) (b) If new data are 
ever added to the original, it 1s easier to add them to 
the remaining right-most columns of the cird format, 
than to add another card to the format or change the 
card format and compress the original variables together. 

Exception: When sight verifying of the cards is planned or there are 
very few variables, separating variables by one or two 
blank columns can be helpful for distinguishing fields. 

15, Rule: Never assign more than one response to each column or 

position in the d?ta format. 



-74- 

8,9 



Rationale: 



Multiple punches in the same column always require 
specially written decoding programs to read the data. 
Any savings in formatting space gained by multiple 
punching will be lost in time and money required to read 
multiple punched data. 



Example: 



A questionnaire item, requesting -the res-pondent to "circle 
tl- choices" should be' formatted with three columns, 
one for each possible choice of the respondent. 



16. Rule: 



Gui delines for Keypunching and Editing Data 



When sending cards to be keypunched or ' .ytaped, request 
that the cards be verified. 



Rationale: 



Verifying cards or tapes costs about twice as much as 
simply having the cards punched but helps insure greater 
punrhing accuracy. 



Exceptions: 



If, for some reason, a small number of punching errors 
are acceptable, or if the number of cards to be punched 
is few enough that a sight check of accuracy can be 
performed, card or keytape verification is unnecessary. 



17. Rule: 



When giving the data to the coder or keypuncher, include 
very specific and precise instructions about the format 
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and the coding scheme. Instruct the coder or keypuncher 
to call or ask about any questions he/she has and to 
set aside those documents about which there are unanswered 
questions. 

Frequently, questions arise during the coding or punching 
phase about which the data user must make decisions and 
must be aware. Without specific Instructions to call about 
questions, some keypunchers and coders will simply makp 
their own decision and continue. _ _ 

Before setting up a data format and deciding on coding 
schemes, examine the responses to a few of the returned 
questionnaires. 

Rationale: Very often unusual or unexpected responses appear, particularly 
on questionnaires; examination of a few returned question- 
naires before designing a format or setting up coding 
schemes will help insure that the "strange" responses can 
be accomrodated "^y the data format and response codes. 

19. Rule : Before final i'^ing the plans for the format and code values 

for the Hata, discuss both with someone who is ^amillar 
with the kind of analysis programs that are or may be 
required. 



Rationale; 



18. Rule: 
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A data processing person (may be a research assistant, 
programmer, systems analyst, etc.) can often spot potential 
P'oblem areas in either the format for the data or in 
particular ci, ices for coding responses. 

Always make some kind of data editing check as the first 
step after th° punched cards or keytape have oeen returned. 

Without fail, some errors will occur in the process of 
transcribing raw data to tape or cards; therefore, at a 
minimum, before doing any analysis, a computer run should be 
made that prints out-of-range responses for all variables 
and checks for duplicate ID numbers and card numbers. (If 
the number of cards is small, the editing check can be 
done by hand.) Examination of this output should point 
out errors where the data were out of the acceptable or 
reasonable range and where ID numbers were mispunched. 
Other errors, such as coding or keypunching errors where 
digits are reversed or mispunched within the acceptable 
range are harder to f^"nd: (a) If the data set wa» rants 
the procedure, there are a number of schemes for creating 
"check digits" to detect certain types of transcribing errors 
(b) One can also check by hand a random sampling of question- 
naires against the corresponding punched cards or tape 
records to estimate the error rate for all questionnaires, 

! 
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and simply report these values in the summary document 
for the study. 



Noce: Data transgeneration or rearrangement tasks (see rules 

7 and 11) can be combined with the data editing run so 
that all three are accomplished in one program. . 

21. Rule: Edit the entire data field for a variable; do not edit 

each column separately within the data field. 

Rationale: Fewer errois will occur and less editing checks will be 
required if each variable 1s edited ,s a field. 

Example: The variable, SAT verbal score (range 200 - 800), should 

be edited as one field to check for scores less than 200 
or greater than 800. This variable should not be 
edited as three columns, the first ranging from two to 
eight and the second and third ranging from zero to nine. 

22. Rule: As a general rule, numbers should be punched right-justified 

and alphabetic characters punched left-justified. 

Rationale: The term right-justified means that the data are punched 
all the way to the right in the field (e.g., If columns 
21 through 23 contain a code for curriculum, then curriculum 



ERLC 



•78- 



93 



; 


code "1" will be punched as bbl rather than Ibb, "where "b" 


1 


means a blank column). Left- justified is the reverse of 




right-justified (i.e., the name "Jones" in an eighc column 


1 


name field would be punched "JONESbbb" instead of bbbJONES"). 


1 


Alphabetic characters are normally used for printing and 




labelling purposes where it makes sense to punch the data 


1 . 


as we read, from left to right.' Numbers, on the other hand. 


- 


are usually used for computations, in which case it makes 


■ 


sense to punch them the way we would write them to add up a"' " 


I 


column of figures. Also, "Ibb" would be read by the comouter 




as "100" without special instructions to the contrary. 


23. Rule: 


As a general rule, request that the keypuncher precede 


■ 


numeric fields with zeroes (zero-fill) when the number to 


1 


be punched does not fill up the entire field. 


1 Rationale: 


Keypunching accuracy, rhythm, and speed will be ;r:creased 




if each field requires the same number of punches for all 




respondents. 


Note: 


Alphabetic or character fields (left-justified) should be 


I 


punched with blanks in any columns remaining in the field 


■ 


to the right of the punched data. 
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24. Rule: After the keypunching and after the final editing phases, 

obtain a listing of the raw data for documentation and 
reference purposes. 

There are many times during the data editing and even the 
analysis phase of a project when It is necessary to refer 
back to the raw data. The cards could be used for this 
purpose, but a paper listing. is easier to handle, and does 
not jeopardize the order or the condition of the cards. 

If the complete set of data is extremely large (so 
that a complete data listing would be cumbersome and 
require a large volume of paper), a listing cf the first 
100 records or every Nth record is still recommended 
(where N is selected so that 100 to 200 records are 
printed). When all the editing and modifications to the 
Lata are completed, a complete listing should then be 
obtained for documentation and reference purposes. 

Guidelines for Documenting and Storing Data 

25. Rule : Dr^ument, in ^'riting, all phases of the coding, punching, 

formatting, and editing steps. 




Rationale: 



Note: 
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Rationale: It Is easy to forget, even after three or four weeks, why 
a decision was made or what the decision was. It is a good 
idea to make notes through the entire data transcription 
process of why and what decisions were made. Particularly 
Important is a careful, up-to-date set of documents ci on on 
the data format and coding assignments. If very extensive 
data editing is necessary, it Is also important "to document 
any editing rules and any changes made to the original 
punched data. 

26- Rule: After any Important (costly) change in the data» immeaiately 

make a duplicate copy of all the data for storage separately 
from the working copy of the data. 

Rationale: If the data are stored on cards, problerrs can occur such 
a: the cards being dropped, torn by the card reader, 
sorter, etc., or simply lost. If the data are stored 
on tape or disk file, the tape can be misplaced, and both 
tape and disk files can be inadvertently scratched (erased) 
Thus, it is important, no matter what storage form Is 
used to keep a duplicate copy of the data. This rule 
applies primarily to three key points In the data trans- 
cription process: (a) after the data have been received 
from the keypunching area; (b) after any costly computer run 
creating new or modified data; and (c) after the data have 
been edited and finalized. 



Note: For long-tenn storage of important tapes, one copy of the 

data should be stored in a location such that a fire or other 
damage in one area would not destroy the second copy of the 
data. For short-term storage, cards should be stored 
packed tightly together in an upright position (without 
rubber bands), preferably in a file made for storing 
cards. Cards should be read to tape for long-term storage. 

27. Rule: When storing tapes or cards, ^rite all identifying infor- 

mation on the tape label or cards and, if possible, store 
identifying information with the data. 

After a short period of time, unlabel led tapes or cards are 
difficult to identify; it makes good sense to write on the 
cards (across the top of the deck or on the first card) or 
attach a label to the tape specifying all identifying 
information. A copy of the data format can also be folded 
and stored next to the cards or inside the tape cover. 
The identifying information should include: (a) creation 
date, (b) description of data, (c) sequential run or data 
set number, and (d) all information required for using the 
tape or cards - 

When storing cards, it is a good idea to put a diagonal 
line across the top of all the cards (with a felt-tip pen) 
and to write "F/C" and "L/C" on the first and last cards, 
respectively. 

-82- ' 97 



Rationale: 



Note: 
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Summary 



Preparing a good data file from raw input data is an important and often 
neglected phase of any effort involving data collection. By following the 
guidelines given in this paper, it is hoped that some of the problems that 
occur in preparing a data file can be avoided. It is obvious from the rationale 
for many of the rules given here, that creating a good set of computerized 
data is, to a large extent, a matter of applying common sense: thinking 
through how the data will be used, who will use the data, and what form of the^ 
data will be required for current and future analyses: in short, preparing 
for multiple contingencies. 

For quick reference, the rules have been listed again below in abbreviated 
form: 

1- Do not assign a code of zero to responses, particularly categorical 
responses . 

2. Assign numeric codes to categories; do not use alphabetic codes to 
indicate responses to variables. 

3. Missing data values should be coded as blanks. 

4. Don't punch or code decimal points (or other punctuation such 
as "$'*, commas, etc.). 

5. Don*t change uncategori zed data into categories, combine one or 
more responses as one code, or collapse categories of responses into 
smaller number of categories at the time of coding or punching. 

6. Use identical codei for all items in a questionnaire with the same 
responses. 

7. Numeric codes for calegorical responses should correspond to implicit 
ordering of the responses. 
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8. Code values assigned tc response categories should be consecutive 
integers ranging from "1" to K, where K is the number of categories, 

9. Where possible, assign standard codes to questionnaire responses. 

10. Always assign a numeric identification (ID) number and sequence 
number to every card in the data set so that each card has a 
unique number identifying its sequence. 

11. The ID number should be the first set of data on each card, followed 
by card or sequence numbers (within ID numbers), followed by 
frequently used respondent information, with data responses 
appearing last on the card(s). 

12. The data format or lay-out should be organized in the same order 
as the questionnaire responses except where a conflict exists with 
rule 11. 

13. A data field, such as card sequence number or ID number, which 
appears on every card per respondent should be located in the same 
columns on each card. ^ 

14. In general, card columns should be filled, starting with column 
one, without spaces (blank columns) between the variables. 

15. Never assign more than one response to each column or position in 
the dat^ format. 

16. When sending cards to be keypunched or keytaped, request that the 
cards be verified. 

17. When giving the data to the coder or keypuncher, include ver^ 
specific and precise instructions about the format and the coding 
scheme. Instruct the coder or keypuncher to call or ask about any 
questions he/she has and to set aside those documents about which 
there are unanswered questions. 

18. Before setting up a data format and deciding on coding schemes, 
examine the responses to a few of the returned questionnaires. 

19. Before finalizing the plans for the format and code values for the 
data, discuss both with someone who is familiar with the kind of 
analysis programs that are or may be required. 

20. Always make some kind of data editing check as the first step 
after the punched cards or keytape have been returned. 

21. Edit the entire data field for a variable; do not edit each column 
separately within the data field. 
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22. As a general rule, numbers should be punched right- justified and 
alphaoetic characters punched left-justified. 

23. As a general rule, request that the keypuncher precede numeric 
fields with zeroes (zero-fill) when the number to be punched does 
not fill up the entire space. 

24. After the keypunching and after the final editing phases, obtain 

a listing of the raw data for documentation and reference purposes. 

25. Docunr.ent, in writing, all phases of the coding, punching-, formatting, 
and editing steps. 

26. After any important (costly) change in the data, immediately make 
a- duplicate copy of all the data for storage separately from the 
working copy of the data. 

27. When storing tapes or cards, write all identifying information on 
the tape label or cards and, if possible, store Identifying infor- ' 
mation with the data. 
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PART II 

OVERALL LISTING OF MEASURES INCLUDED 



Community Outcome Measures and Procedures 
A. Economic Outcome Measures 

A-1 Annual income according to amounts of college education 
A-2 Occupational access of women and minorities according to 

amounts of college education 
A-3 Geographic mobility of college graduates compared to those 

not attending college 
A-4 - Use of college experience for screening and hiring 
A-5 College impact on employee absenteeisn^ and tardiness 
** A-6 Institution's purchase of locally delivered goods and 
services 

** A-7 Institution's capital equipment expenditure relevant to the 
local community 

** A-8 Institution's capital construction expenditure relevant to 

the local community 
** A-9 Local expenditures by faculty and staff 
** A-10 Local expenditures by students 
** A-11 Local expenditures by visitors 
A-12 Occupational level and advancement 
A-13 Payment of individual local and state taxes by college 

graduates compared to others 
A-14 Contribution to community attractiveness for employers 
** A-15 Institutions payment of local and state taxes and box 
compensations 

** A-16 Institution's purchase of locally provided utilities 
** A-17 Employee productivity as related to college 
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B. Facility and Event Provision Measures 

B-1 The annual number of people attending athletic, cultural, or 

other events provided and/or sponsored by the institution 
** B-2 Community participation in an institution's social, cultural, 

and recreational programs 
B-3 The number of column inches of newspaper coverage received by 

institutional events In local, regional, and national newspapers 
B-4 . The number of institutional facilities made available to the 

community and the financial investment that the institution has 

in these facilities overall and in each 
** B-5 Community use of institutional facilities 

C. Service Provision Measures 

C-1 Enrollment of regular degree/diploma/certificate students 
from the community 
** C-2 Enrollment of non-degree and non-certificate seeking students 
** C-3 Community participation in community education programs 
** C-4 Community participation in educational extension programs 
** C-5 Educational goals achieved by community participants 

* C-6 Community awareness and use of, and satisfaction with, instruction- 

al programs 

* C-7 Community awareness and use of, and satisfaction with assistance 

services 

* C-8 Community unmet educational needs 

C-9 Amount of advisory and analytic assistance provided by the 
institution to community agencies and citizens 
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C-10 Amount of advisory, referral, and analytic assistance provided 

by institutional staff and students outside 
C-11 Amount of treatment and care service provided to the citizens 

of the conimunity 

C-12 Number of enrolled students employed by community firms during 
the time that they are still students 
* C-13 Institutional goal attainment 

C-14 Students enrolled in an organized educational activity for no 
credit 

NEW KNOWLEDGE, TECHNOLOGY, AND ART FORM MEASURES AND PROCEDURES 
D. Research and Scholarship Outcome l^easures 
** D-1 Research proposals funded 
** D-2 Research Restricted Revenues 

D-3 Books authored/coauthored by faculty and former students 
D-4 Books edited by faculty and former students 
D-5 Chapters or readings in books by faculty and former students 
D-6 Journal articles authored or coauthored by faculty and former 
students 

D-7 Citation index applied to faculty and former students 

D-8 Periodicals edited by faculty and former students 

D-9 Selections to editorial boards of faculty and former students 

D-10 Papers published in professional association proceedings by 

faculty and former students 
D-11 Papers presented at professional meetings by faculty and former 

students 
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D-12 Informal/unpublished papers by faculty and former students 
D-13 Number of patents and copyrights granted to faculty and 
former students 

D-14 Number of dissertations supervised by faculty and former 
students 

D-15 Awards to faculty and former students from professional 
associations 

D-16 Offices held in professional associations by faculty and 

former students 
D-17 Number of visiting scholars or researchers 
D-18 Honorary degrees awarded to faculty and former students 
D-19 Number of fellowships awarcfed to faculty and former students 
D-20 Number of endowed chairs 

D-21 Number of faculty and former students invited to make 

presentations to professional and other meetings 
D-22 Number of faculty and former students invited elsewhere to 

be visiting professors and scholars 
D-23 Number of faculty and former students serving on special 

invitation commissions, councils, study teams, or committees 

of experts 

D-24 Number of faculty and former students listed in American Men 

of Science, Who's Who, and other such works 
D-25 Amount of use or application received by technological products 

developed 

D-26 Assessed economic valuation of the technological products developed 
D-27 Assessed social impact of technological products developed 
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E. Art Fori., a Work Outcome Measures 

E-1 Number of art works or performances completed 

E-2 Number of art works entered into formal local, state, and 

national competitions 
E-3 Number of art works or performances commissioned by others 
E-4 Number of awards and recognitions received in artistic 

competitions 

E-5 Amount of awards and recognitions received outside of artistic 
competitions 

E-6 Number of invited showings and displays of art forms and works 
E-7 Number of artistic auditions, recitals, and public performances 
E-8 Ratings and recognitions received by reviewer critics 
E-9 Number of by-line credits to one's name 

E-10 Number of times one is interviewed by the press, radio, or TV 

because of one's artistic production or renown 
E-11 Being on the social register because of one's artistic 

production or renown 
E-12 Having a biography written about one because of artistic 

production or renown 
E-13 The amount of money that one's art works or performances will 

attract on the open market 
E-14 Being recognized as one who initiated a new art form or style 



STUDENT ECONOMIC OUTCOMES 

F, Economic Access and Independence Measures 

** F-1 Student success in obtaining first job after leaving the 
institution 

-93- 



106 



** F-2 Student success in obtaining preferred first job 

** F-3 First job earnings 

** F-4 Annual total income of former students 

F-5 Discrepancy between current and desired socioeconomic level 
for former students 

F-6 Self-report of perceived economic security and the contribution 
of college to that security 

F-7 Geographic dispersion and mobility of graduates 
G. Economic Resource, Efficiency, and Production Measures 

G-1 Amount of absenteeism and tardiness on the job among graduates 

G-2 Percentage of graduates employed in management positions 

n 

G"3 Percentage of graduates who as a result of attending college 

can do their own income tax forms, legal contracts, typing, etc. 

G"4 Percentages of graduates involved in consultative activities 
for a fee 

G-5 Perceived effect of college on efficiency, production, and 
motivation on the job 



STUDENT HUMAN CHARACTERISTIC OUTCOME MEASURES AND PROCEDURES 
H. Aspi rational Outcome Measures 

** H-1 Students seeking r.dditional degrees and certificates 
** H-2 Highest degree or certificate planned 
** H-3 Change and stability of career goals 

H-4 Change in reported aspiration for graduate school 
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H-5 Change in reported interests and likes or dislikes 
H-6 Score or change in score on interest inventories 
H-7 Score or change in score on need for achievement and 

achievement motivation scales 
H-8 Self-report of perceived change in motivation or drive level 
I. Competence and Skill Measures 

I-l Student success in passing certificatic and licensing - 
. examinations 

1-2 Score or change in score on a study skills test 

1-3 College GPA 

1-4 College persistence 

1-5 Score cr change in score on a test measuring citizenship and 

family membership skills 
1-6 Score or change in score on a test of creativity and original 

thinking 

1-7 Score or change in score on a test measuring the ability to 

communicate or express oneself 
1-8 Score or change in score on a test that measures the ability 

to analyze and solve problems and to make inferences 
1-9 Score or change in score on a test that measures leadership and 

interpersonal ability 
I-IO Score or change in score on a test measuring specialized skills 

required for a particular occupation 
I-U Score or change in score on tests that measure physical 

and motor skills 

1-12 Expert judges* ratings based on direct observation of student 
performance on competencies of concern 
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1-13 Proficienc and contest awards in areas such as leadership, 

communication, athletics, etc. that depend on the competencies 
of concern 

1-14 Self-report in an open-ended manner or using rating scales 

of one's proficiency in particular areas 
Morale, Satisfaction, and Affective Outcome Measures 
J-1 Student satisfaction with overall educational experience 
J-2 • Student satisfaction with vocational p^^eparation 
J-3 Student satisfaction with college services 
J-4 Student success in obtaining a job 

J-5 Student satisfaction with knowledge and skills in the humanities 
J-6 Student satisfaction with critical thinking ability 
J-7 Student satisfaction ,/ith human relations sk'ills 
J-8 Job satisfaction 

J-9 Student postgraduate satisfaction with life in general 

J-10 Score or change in score on an attitude scale 

J-11 Score or cnange in score on an instrument that assesses values 

J- 12 Score or change in score on an instrument that assesses beliefs 

J-13 Score or chanpe in score on an instrument that measures 

socialization, mores, and standards of conduct 
J- 14 Appreciation of different cultures and a wide range of human 

values 

J-15 Self-report of attitudes, values, and philosophy of life 
J-16 Religious or ethi ul organization memberships, participation, 
and support 
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J-17 Observed objectivity or subjectivity and emotion guiding one's 

standards of conduct 
J-18 Amount of openness and acceptance of one's feelings 
J-19 Self-report of one's feelings, emotions, and affective disposition 
K. Perceptual Characteristic Outcome Measures 

K-1 Score or change in score on a self-concept scale 
K-2 Amount of self-regard and self-confidence 

K-3 Amount of sensitivity to the needs and emotional cues presented 
by others 

K-4 Amount of alertness to the opportunities confronting one 
K-5 Observed amount of respect for others and their ideas 
K-6 Whether one sees things assail *'black and white" or complex grays 
K-7 Self-report of one's view of self and of others 
L. Personality and Personal Coping Characteristic Outcome Measures 
L-1 Score or change in score on an instrument that measures 

adventurousness and initiative 
L-2 Observed frequency of speaking out on issues 
L-3 Score u. change in score on an instrument that measures autonomy 

and independence 
L-4 Score or change in score on an instrument that measures 

dependability and responsibility 
L-5 Score or change in score on an instrument th-t measures 

amount of dogmatism, authoritariani:*m, and open-mind'?dness 
L-6 Score or change in score on an instrument that measures 

flexibility and adaptability 
L-7 Score or change in score on an instrument that assesses one's habits 
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L-8 Score or change in score on an instrument that measures 

psychological functioning 
L-9 Score or change in score on an instrument that measures amount 

of tolerance and persistence 
L-10 Self-report about change in personality and personal coping 

characteristics as a result of college 
L-11 Observation by others of change "^n personality and personal 
. coping characteristics 
M. Physical and Physiological Characteristic Outcome Measures 
M-1 Score or change in score on a physical fitness test 
M-2 Medical doctor's health physical examination report 
M-3 Self-report of health and how well one feels physically 
M-4 Score on tests designed to measure physical physiological 
characteristics 
N. Status, Recognition, and Certification Outcome Measures 

N-1 Program completers during a certain time period 
** N-2 Program completers who entered as transfer students 
** N-3 Degrees and certificates earned by an entering class of students 
** N-4 Time to program completion for a graduating class 
** N-5 Time to program completion for an entering class 
** N-6 Entering program dropouts 

** N-7 Students working toward and receiving another degree or certificate 
** N-8 Student ability to transfer courses 

** N-9 Level of achievement of former students in another institution 

* N-10 Student status at withdrawal time 

* N-11 Reasons for students withdrawing from the institution before 

completing a program 
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N-12 Term and course completion percentages 

N-13 Self-report of personal goal attainment status 

N-14 Reasons for attending college related to persistence/ 

withdrawal status 
N-15 Credit hours completed 
N-16 GPA 

N-17 Employment in major field of study 

N-18 Being accepted for entrance tc graduate or professional school 
N-19 Score on graduate school exams 
N-20 Graduate school grades 

N-21 Being selected by the civil service, if applied 

N-22 Student success in passing certification and licensing examinations 

N-23 Social and professional awards and listings 

N-24 By-line credit for a movie, play, book, article, etc, 

N-25 Employer's rating of overall on-the-job performance 

N-26 Employment promotion success 

N-27 Appointment or election to a community or professional position 

of status or authority 
Social Activity and Role Outcome Measures 
0-1 Occupational career choice 

0-2 Graduate self-report of the effect of having attended colK^e 
on the affiliations sought and the affiliations won 

0-3 Social roles and avocations of college graduates 

0-4 Career roles and advancement 

0-5 Percent voting in municipal and state elections 

0-6 Participation in, leadership roles served, and support of 
religious and service organizations 
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0-7 Percent running for public office, involvement in election 

campaigns, and election or appointment to political office at 
any level 

0-8 Family roles 

0-9 Self-report of Lhe effect of college on friendships and 

social relationships 
0-10 Self- report of the effect of college oji cul tura.1 , recreational, 

and other leisure-time activities 
0-11 Self- report of the effect of college on the retirement years 

STUDENT KNOWLEDGE AND UNDERSTANDING OUTCOME MEASURES 

jf 

P. General Knowledge and Understanding Measures 
** P-1 Tested breadth of knowledge and understanding 
P-2 Student grades in general survey courses 

P-3 Observed student performance in simulation situations requiring 

general knowledge and understanding 
P-4 Student self-report of general knowledge and understanding 
P-5 Observation of student presentation on, and defense of a general top 
P-6 Areas and agents of student change during college 

Q. Specialized Knowledge and Understanding Measures 

** Q-1 Tested specialized knowledge and understanding 
Q-2 Student grades in specialized courses 

Q-3 Observed student performance in simulation situations requiring 

specialized knowledge and understanding 
Q-4 Student self-report of specialized knowledge and understanding 
Q-5 Observation of student presentation on, and defense of a 

specialized topic 
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PART III 
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SELECTED MEASURES AND PROCEDURES - 



114 



COMMUNITY ECONOMIC MEASURES 



Outcome structure Category 31.1100 



A-l 



Measure 
Number 



Measure Name 



Annual income according to amounts of college education 



Definition 



Average annual net earnings of women, minorities, and other community citizens having 
various amounts of college compared to those having no college experience, for overall 
and by occupational/industry type 



Data Sources 



Community citizens, former students 



Procedures 



Access census records, administer community survey questionnaire 



Uses 



Institutional 



state 



Comments 
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COMMUNITY ECONOMIC MEASURES 



Outcome Structure Category 3i.iiio 



A-2 



Measure 
Number 



Measure Name 



Occupational access of women and minorities 



Definition 



The proportion of minorities and women in the community that are employed within 
particular job levels according to their amount of college experience, for overall 
and by occupational /industry type 



Data Sources 

Community citizens, former students 



Procedures 



Access census records, administer community survey questionnaire 



Uses 



Institutional 



State 



Comirents 
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COMMUNITY ECONOMIC MEASURES 



Outcome structure Category 3i.ii20 



A- 3 



Measure 
Number 



Measure Name 



Geographic mobility of college graduates compared to those not attending college 



Definition 



Percentage of community citizens moving into and out of the community, and how far they 
travel, according to their amount of college experience, for overall, and by 
occupational/industry type 



Data Sources 



Community citizens, former students 



Procedures 



Administer alumni and community servey questionnaires 



Uses 



Institutional 



State 



Comments 



Ieric 
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COMMUNITY ECONOMIC MEASURES 



Outcome structure Category 21.1210 



A- 4 



Measure 
Number 



Measure Name 



Use of college experience for screening and hiring 



Definition 



The percentage of community firms that give significant weight to the amount and type of 
college experience in screening prospective employees and hiring, for over and by 
business/ industry type 



Data Sources 



Community employers 



Procedures 



Conduct interviews with employer personnel office directors and/or mail out employer 
questionnaires 



Uses 



Institutional 



State 



Comments 
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COMMUNITY ECONOMIC MEASURES 



Outcome Structure Category 31.1210 



A-5 



Measure 
Number 



Measure Name 



College impact on employee absenteeism and tardiness 



Definition 



The amount of excessive absenteeism and tardiness on-the-job experienced by- community 
employers according to the- amount of employee college experience, for overall, by 
employee occupational level, and by business/industry type 



Data Sources 



Community employers 



Procedures 



Conduct interviews with employer supervisors and personnel office directors and/or 
mail out employer questionnaires 



Uses 



Institutional 



Comments 



state 
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COMMUNITY ECONOMIC MEASURES 



Outcome Structure Category 3i.ii30 

31.1220 



A-6__ 

Measure 
Number 



Measure Name 



Institution's purchase of locally-delivered goods and services 



Definition 



Total amount of dollars expended on goods and services that are purchased by the 
institution from the local^ community during a certain time period. Goods and 
services are distinguished" from capital equipments generally defined by each 
institution in terms of dollars and duration (see COMMENTS). Also, goods and services, 
as referred to here, do not include utilities purchased from the local community 
(see Outcome Measure K-2). 



Data Sources 



Institutional Business Office 



Procedures 



Search of Institutional Records 



Uses 



Institutional 



Comments 



state 



This measure was included in the original field review document, and has been piloc- 
tested. 

In separate "goods and services" from "capital equipment" each institution uses 
different criteria of dollars and duration. The user of the manual should consult 
the institution's business office to determine the criteria for distinguishing 
goods and services from capital equipment. 
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COMMUNITY ECONOMIC MEASURES 



ACQUISITION PROCEDURES FOR OUTCOME MEASURE A-6 



Considering the potential diversity in purchasing methods and record keeping 
among institutions, it is expected that users of the manual will have to 
make several decisions during the course of gathering the data for this measure. 
For the purpose of clarifying the process of searching institutional records 
to obtain the desired information, a simple flow cha'rt is presented in 
Figure A-1 on the next page. The user may consult the information search 
process suggested in the figure and make a general plan applicable to his 
or her particular situation prior to engaging in the data collection activity. 

f 
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COMMUNITY ECONOMIC MEASURES 



Figure A-1 

INFORMATION SEARCH PROCESS FOR OUTCOME MEASURE A-6 



"RCH 

^\ INSTIT .ONAL RECORDS 
( START) 



DO riOT KMOW 




ASSEMBLE THE 
FIGURES BY 
LOCAL ADDRESS 



ASSEMBLE THE 
FIGURES BY 
LOCAL 
ADDRESS 



LIST 
ALL PURCHASING 
UNITS 




NO 



AGGREGATE 
THE FIGURES 
FOR 

ALL UNITS 



OUTPUT 



TOTAL AMOUNT OF DOLLA^X 
SPENT FOR LOCALLY DELIVERED^ 
GOODS AND SERVICES j ^' 

(END) y 
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COMMUNITY ECONOMIC MEASURES 



Procedures for Use of Institutional Records 

1. Identify the time period during which the total amount of dollars 
expended on goods and services that 3re purchased by the institution 
from the local community are to be determined. 

2. Determine the boundary of the institution's functional local 
community > 

3. Consult the institution's business office to determine whether the 
purchasing activity of the institution is carried out by a central 
purchasing office or by subunits (^departments and other 
organizational .units) within the * stitution. 

4. If the purchasing activity ii^ central ^*^ed, determine whether the 
purchasing records contain the addresses of the suppliers in the 
designated local community. If they do, it is simply a matter of 
retrieving the information according to the planned format. If, 
however, the record files do not contain the local supplier's 
addresses, the user of the manual will have to obtain such infor- 
mation from the existing files that contain the vendor register 
or invoice vouchers. 



If, by chance, the user attempts to use an aggregate figure that 
already has been developed by certain offices, care should be 
taken about the reliability of that information. For example, 
the user might check the aggregate information against the 
original data or check the inforn Mon generated by one office 
against that generated by another office. 
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COMMUNITY ECONOMIC MEASURES 



5. If the purchasing activity is not centralized or the needed 
information is not centrally available, the following steps 
should be taken: 

a. Consult the uns'-itution's business office and identify 
all purchasing units within the institution. 

b. Contact' the person in charge of each purchasing unit's 
expenditure records and obtain the needed information 
for deriving the measure. 

6. Calculate the total amount of dollars paid by each purchasing 
unit in the institution to suppliers in the designated func- 
tional local comnunity within the specified time period. 
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COMMUNITY ECONOMIC MEASURES 



Outcome Structure Category 31.1130 



31.1220 



A-7 

Measure 
Number 



Measure Name 



Institution's capital equipment expenditure relevant to the local community 



Definition 



Total amount of dollars expended in the local community by institutions as a result of 
an institution's capital outlay expenditure. Capital outlay is usually defined in terms 
of a "good" with the cost exceeding (1) a certain amount of dollars and (2) the duration 
of useful life of the "good" years. The criteria may vary somewhat among institutions, 
■(see COMMENTS) 



Data Sources 

Institutional Business Office 



Procedures 

Search of Institutional Records 



'Jses 



Institutional 



State 



Comments 



This measure was included in the original field review document and has been pilot-tested. 

The user of this procedure is advised to follow the definition of "capital outlay" used 
by the institution. Although the criteria may vary somewhat among institutions, the 
margin of error will be much less significant than that stemming from imposing a new 
definition which would inevitably disrupt the standard operating procedure developed 
in each institution. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE A-? 



Ir. obtaining the data on the total amount of dollars expended in the local 
community by the institution for capital equipment, the user should consult 
the institution's business office and apply the same information search 
procedures as that developed for outcome measure A-7 , j 

As pointed out earlier (see procedures for outcome measure K-3), "capital 
outlay" is distinguished from "goods and serivces" for expenditure analysis 
purposes. A conceptual distinction -is therefore made 'in the definition of 
outcome measure A-7. | « 
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Outcome structure Category 31.1130 

31.1220 



A-8 



Measure 
Number 



Measure Name 



Institution's capital construction expenditure relevant to the local community 



Definition 



Total amount of dollars expended in the local community by an institution as a result 
of its capital construction expenditure. The capital expenditures include (1) purchase 
of land, (2) land improvement, (3) construction (building and parking lot), (4) building 
repair and improvement, (5) architect's fees, and (6) others that are specifically 
designated by each institution as "capital construction." 



Data Sources 



Institutional Business Office 



Procedures 

Search of Institutional Records 



Uses 


Institutional 


state 


Comments 





This measure was included in the original field review document and has been pilot-tested. 
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ERIC 



ACQUISITION PROCEDURES FOR OUTCOME MEASURE A-8 

It should be pointed out at the outset that the. complexity of the data acqui- 
sition procedures for outcome measure A-8 is dependent upon the level of detail 
the user wishes to explore regarding capital expenditure. For instance, the 
institution may contract with a firm that in turn may subcontract with other 
firms. Therefore, the original contractor- may disperse its capital over several 
localities through a subcontract process. The potential complexities involved 
in this process suggest that for analytic purposes some constraints must be placed 
on the level of detail associated with the flow of an 'institution's capital - 
expenditures out to the designated funcjtional local coninunity. 

The following procedure calls for examination of only those capital 
expenditures associated with the original contracts arranged between the 
institution and the local firms. In addition, it is recommended that 
the focus be limited to the original amount of dollars specified in the 
contract. 

Procedures for Use of Institutional Records 

The following procedural steps are designed to obtain that portion of an 
institution's capital dollars that are spent in the local designaced func- 
tional community: 

1. Identify the period of time in which the capital expenditures 
in the local community are to be examined. 

2. Determine the boundaries of the functional local coimiunitv . 
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Consult the institution's business office to examine the 
institution's State of Changes in Fund Balance and its 
supporting documents . 

The Statement of Changes in Fund Balance shows the total amount 
of capital expenditures including the major components over a 
given year. It does not, however," provide the" localities in 
which the capital budget has been spent; The supporting doc- 
uments will show in detail from whom the land was purchased, 
if any, what specific projects were financed, and to whom 
contracts were awarded. 

Examine carefully the supporting documents and identify for 
each project (or fiscal transaction): 

a. The address(es) of the firm(s) (or individuals) from 
which land was purchased, if any; 

b. The address(es) of the firm(s) to which contracts were 
awarded; and, 

c. The amount of dollars associated with each financial 
transaction. 

Select the projects and the firms located in the designated 
local community. 

The following table is suggested for organizing the capital 
expenditure data: 
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lype OT capital 
expenditures 


Name of the localities 
in which capital budget 
is spent 


Amount of 
dol lars 








TOTAL : 
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Outcome Sfucture Category 3i.ii30 



A-9 

Measure 
Number 



Measure Name 



Local expenditures by faculty and staff 



Definition 



Total amount of dollars that the faculty and staff in an institution 
spend in the local cormunity during a certain period of time 



Data Sources 



Institutional Business Office 



Procedures 



Administration of a Survey Questionnaire 



Uses 



Institutional 



State 



Comments 



This measure was included in the original field review document and has been pilot-tested 
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QUESTIONNAIRE ITEMS FOR OUTCOME MEASURE A-9 

The set of questionnaire items developed for obtaining the data needeci for 
outcome measure A-9 is a modification of a group of the items used in a 
community impact study conducted by the Office of the Vice-Presi Jent 

for University Relations at the University of Colorado (Rautenstraus, 1974). 
The items have been modified with the permission of the author of the study 
report. 

Procedures for a FACULTY and STAFF Questionnai re 

f 

[SEE FOLLOWING PAGE] 
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The following items are intended to help in estimating the economic 
impact of [Name of Institution] on the local community , 

1. What is your primary employment status at [Name of Institution]? 

J(l) Full-time Faculty 

0(2) Part-time Faculty 

[□(3) Full-time Staff 

□ (4) Part-t'me Staff 



2. Approximately how far do you live from campus? (Please write in the 
space below the estimated number of miles.) 

Miles 



3. In what type of housing do you reside? 

□ (1) Rent 

□ (2) Own home 



4. Please estimate your average monthly expenditures in the folowing 
categories: InOTE: These estimates will be strictly aonfidential.^ 



Rent or house payment $ 

Utilities (water, gas, electric, telephone, disposal) . . $' 

Food and beverages $' 

Real estate and other local taxes $' 

Automobile (payment, repairs, gas, insurance) $' 

Charitable donations $' 

Cleaning and laundry $" 

Clothing $" 

Entertainment $" 

Furniture $" 

Health (include dental and insurance) $' 

Insurance (except auto and health) $' 

Local public transportation $' 

Magazines and newspapers $' 

Personal items $' 

Miscellaneous $' 

TOTAL $■ 



5. What is your yearly expenditure for books and educational 
supplies? $ 
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Outcome Structure Category 3i.ii30 

31.1220 



A-IO 

Measure 
Numbe^" 



Measure Name 



Local expenditures by students 



Definition 



Total amount of dollars that students spend in the local community during a" certain 
period of time 



Data Sources 



Current Students 



Procedures 



Administration of a Survey Questionnaire 



Uses 



Institutional 



Comments 



state 



This measure was included in the original field review document, and has been 
pi lot- tested 
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QUESTIONNAIRE ITEMS FOR OUTCOME MEASURE A-10 

The set of questionnaire items developed for obtaining the data needed for 

outcome measure A- 10 is a modification of a group of the items used in a 

community impact study conducted by the Office of the Vice-President 

for University Relations at the University of Colorado (Rautenstraus, 1974). 

The items have been modified with the permission of the author of the study 

report. 



Procedures for a CURRENT-STUDENT Questionnaire 

1 

[SEE FOLLOWING PAGE] 



-123- 



ERIC 



135 



COMMUNITY ECONOMIC MEASURES 



The following questions are intended to help us learn about the economic 
impact students at [Name of Institution] have on the local community . 



1. What is your student status at [Name of Institution]? (PLEASE CHECK ONE) 

□ d) Freshmen (111(4) Senior 

□ ( 2) Sophomore CU (5) Graduate 
(111(3) Junior (ZD (6) Special 



2. Are you currently a full-time or part-time student? 

0(1) Full-time student EZ] (2) Part-time student 

3. Approximately how far do you live from campus? (Please write in 
the space below the estimated number of miles.) 

Miles 



4. In what type of housing do you live? ^(PLEASE CHECK ONE) 

ri](l) Campus housing 1^1(4) Fraternity or Sorority 

CH (2) Rent [□ (5) Live with parents 

I I (3) Own home 



5. Please estimate your average monthly expenditures in the folowing 
categories: [NOTE: These estimates will be strictly confidential.] 



Rent or house payment $ 

Utilities (water, gas, electric, telephone, disposal) . . $ 

Food and beverages $ 

Real estate and other local taxes $' 

Automobile (payment, repairs, gas, insurance) $' 

Charitable donations $' 

Cleaning and laundry $' 

Clothing $' 

Entertainment $' 

Furniture $" 

Health (include dental and insurance) $' 

Insurance (except auto and health) $' 

Local public transportation $' 

Magazines and newspapers 

Personal items $' 

Miscellaneous $' 

TOTAL $' 



6. What is your yearly expenditure for books and school supplies? $ 
Tuition and fees? $ 
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Outcome structure Category 31.1130 



31.1220 



A-11 



Measure 
Number 



Measure Nam 



Local expendi 


'tures by visitors 


Definition 





A total amount of dollars that visitors to an institution spend in the local 
community during a certain' period of time 



Data Sources 



Faculty, staff, students, and academic units, (such as departments and institutes) 
and visitors 



Procedures 



Adanni strati on of a Survey Questionnaire 



Uses 



Institutional 



Comments 



state 



This measure was included in the original field review document and has been pilot-tested. 
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QUESTIONNAIRE ITEMS FOR OUTCOME MEASURE A- 11 

Administration of a survey questionnaire is su^ jested for obtaining an 
estimate of the total amount of dollars that visitors at an institution 
spend in the designated functional local community during a given period 
of time. 

Three alternative sets of questionnaire items have been developed for 
consideration. The first set is appropriate for administration to fac- 
ul y, staff, aiid students. The second set is designed to be administered 
to the heads of departments or other or^ganizational units in the institu- 
tion that have sponsored activities attended by visitors from outside the 
designated functional local community. The final set of items is designed 
to be administered directly to visitors. 

Procedures for VISITOR-EXPF^'DITURE Questionnaires 

[SEE FOLLOWING PAGE] 
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Alternative #1: Faculty/Staff/Student Questionnaire 



FACULTY/STAFF/STUDENT QUESTIONNAIRE 



INSTRUCTIONS: The following survey questionnaire is intended to learn 
how much money your non-local visitors have spent during [Period of Time] 
in [Name of the local community]. For each type of visitor identified 
below, please give -your best estimates about (1) the number of non-local 
visitors you have had during [Period of Time]— count each visitor's visit 
as one visitor; (2) the average length of their stay--count days; and 
(3) the averetge amount of their daily spending. 



1 



Type of non-local 
visitors 



Number of 
Visitors 



Average length 
of their^ stay 



Average 
daily local 
expenditures 



Sum = 1x2x3 
(Do not write 
in this column] 



Parents & Relatives 



Friends 



Professional 
Colleagues 



All Others 



( ) Days 



( ) Days 



( ) Days 



( ) Days 
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AUernative §2: Organizational Unit Questionnaire 



I 

L 



ORGANIZATIONAL UNIT QUESTIONNAIRE 



INSTRUCTIONS: The following survey questionnaire is designed to estimate 
the amount of local expenditures that have resulted' from the non-local 
visitors who have participated in meetings (or conferences) thai your 
organization has sponsored during [Period of Time].* 



1. 
2. 
3. 



Your name 



Name of your department_ 



During (period of time) has your department' (or organization) 
sponsored any activities, meetings, or conferences, etc. that 
were held in [Name of the Local Community] and in which 
visitors outside the communit:| participated? 

1. YES, we have. (Go to Question 4) 

2. NO, we have not. 



4. 



Please identify the nature (or name) of meetings and make your best 
estimate in the categories that follow: 



Nature (or name) 
of activity 



1 



Number of 
days activity 
lasted 



Estimated 
number of 
non -local 
partici;^ants 



Es ' ''iTiate 
Average Daily 
local expenditures 
of participants 



SUM = 1x2x3 
(Do not write 
in this column 



J- 



*In some instances, the user may wish to account for visitors who come to the 
community for conferences, workshops, etc. that are held in campus facilities 
which are not sponsored by IHE. 
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Outcome Structure Category 31.1220 



A-12 



Measure 
Number 



Measure Name 



Occupational level and advancement 



Definition 



The percentage of community citizens employed in management positions according to 
the amount and type of college experience, for overall and by occupational/industry 
type 



Data Sources 

Community Citizens, Former Students 



Procedures 



Access census records, administer community survey questionnaire 



Uses 



Institutional 



Stat? 



Comments 
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Outcome structure Category 31.1220 

32.1220 



Measure Name 



Measure 
Number 



Payment of individual local and state taxes by college graduates compared to others 



Definition 



Average local and state sales, property, and income taxes paid by community- citizens 
according to their amount of college experience 



Data Sources 



Community Citizens, Former Students 



Procedures 



Administer alumni and community survey questionnaires 



Uses 



Institutional 



State 



Comments 



This measure is also an indicator of the impact of the college on the amount of 
direct community or state aid to individuals, i.e., welfare payments, which would 
be viewed by some as a drain on community and/or state resources. 
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Outcome Structure Category 21.1220 

31.1220 



Measure Name 



Contribution to community attractivenes s for employers 

Definition 



The percentage of community firms reporting that the presence of a/this postsecondary 
education was a significant factor in their decision to locate/stay in the 
community, for overall and by business/industry type 



Data Sources 



Business and Industry Officials 



Procedures 



Conduct interviews with and/or send a questionnaire to business and industry 
officials 



Uses 



Institutional 



State 



Comments 
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Outcome Structure Category 31.1220 



A- 15 



Measure 
Number 



Measure Name 



Institution's payment of local and state taxes and tax compensations 



Definition 



All local taxes and tax compensations (payment made in lieu of taxes) that an institution 
pays to local governments (e.g., city, county, state) including school districts, towns, 
cities, counties, and so forth ■ . 



Data Sources 



Institutional Business Office 



Procedures 



Search of Institutional Records 



Uses 



Institutional 



State 



Comments 



This measure was included in the original field review document and has been pilot-tested. 

Most educational institutions are free from local tax assessments except for an 
institution's commercial or related activities. However, exceptions do occur. For 
example, some institutions may enter an eyreement with the local government to pay 
certain amounts in order to compensate fur the eroded tax-base due to their presence 
in the conmunity. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE A- 15 

The data for outcome measure A-15can be obtained through a search of insti- 
tutional records, generally maintained in the institution's business office. 

Procedures for Use of Institutional Records 

1. Identify the period of time during which data for the 
measure will be examined. 

2. Contact the chief business officer in the institution 
and determine: 

a. If the institution paid any locally assessed taxes 

during the time period in focus. If so, the following 
table should be completed: 



Type of 
Taxes Paid 


Name of Local Governments 
To Which Taxes Were Paid 


Amount Paid 


Property Tax 






Sales Tax 






Income Tax 






Other (please 
specify) 






TOTAL: 
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b. If the institution paid or donated any amount of dollars 
to the local government(s) in lieu of taxes (for example, 
in compensation for the eroded tax base) during the time 
period in focus, the following table should be completed: 



Type of Payments 
or Donations 


Name of Local Governments 

To Which Payments or 
Donations Have Been Made 


Amount 
Paid 








'{ 

TOTAL: 
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Outcome Structure Category 31.1220 



A-16 



Measure 
Number 



Measure Name 



Institution's purchase of locally provided utilities 



Definition 



Total amount of dollars expended on utilities (such as gas, electricity, garbage 
collection, sewage treatment) which were purchased from the local community during 
a certain time period) 



Data Sources 



Institutional Business Office 



Procedures 



Search of Institutional Records 



Uses 



Institutional 



State 



Comments 

This measure was included in the original field review document and has been pilot-tested 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE A- 16 

Most institutions pay standard rates for locally provided utilities and the 
payments generally are made by the business office. Therefore, cost data on 
utilities purchased from the local community should be obtainable by simply 
searching the institution's utility payment records. 

Procedures for Use of Institutional Records ' 

The following procedural steps are suggested for obta.ining the total dollar 
figure for locally provided utilities: 

H 

1. Identify the time period during which the amount of 
dollars expended on locally provided utilities will be 
determined. 

2. Determine the boundary of the institution's functional 
local community . 

3. Identify the types of utilities that have been purchased from 
the defined local community. 

4. Tabulate payment figures by using the following format: 
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Type of 
Utility 


Name and address of the businesses in the 
local community from which utilities 
have been purchased 


Amount of 
Dollars 








TOTAL: 
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Alternative #3: Visitor Questionnaire 

The following questionnaire has been developed as an alternative for iden- 
tifying the amount of money spent by visitors to the local community. The 
items in the questionnaire are modified versions of items used in a recent 
community impact study conducted by the University of Colorado (Rautenstraus, 
1974). They have been modified for inclusion in this manual with the per- 
mission of the author of the University of Colorado community impact study 
report. 

Various formats and procedures for administering the questionnaire to visiters 
can be used. The one recomnended here cal^s for (1) printing the INTROjUCTORY 
REMARKS and questionnaire items on one side of an 8 1/2 x 11 inch piece of 
paper and (2) printing the return address and a first class business reply 
mail permit on the other side of the paper. 
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VISITOR QUESTIONNAIRE 



WELCOMEI The [Name of Institution] hopes thay you have a good time in 
[Name of Community], The [Name of Institution] is conducting a surve'' 
to determine how much a visitor spends in [Name of Community]. When 
your visit is completed, please fill out this questionnaire and return 
it to us. 

To return the questionnaire, please refold and staple the questionnaire 
so that the top third is covered by the bottom third and the [Name of 
Institution] address and prepaid postage notice is shown. 

Thank you for your help! 

************************************* 

1. How far did you travel to come to [Name of Community]? Miles 



2. How long did you stay in [Name of Coounity]? Days 

3. What were your expenditures in [Name of Community] in the following 
categories? „ 



4. Was your primary reason for visiting [Name of Community] related to 
the [Name of Institution]? 



5. Please check (/) the [Name of Institution] activities that you 
attended during ycur stay: 



Food (of '-campus) 

Lodging 

Other (souvenirs, gas, etc.) 



$ 



□ Yes 

□ no 



Seminar 

Conference 

Forum 




cm Film 
Museum 



Workshop 
Lecture 
I I Concert 
1 I Exhibit 



lZJ Visit with son/daughter 



attending [Name of Institution] 
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I 



On the other side of the questionnaire print the return address and the 
business reply mail permit 30 the respondent can easily fold and staple 
the questionnaire. An example of what the other side of the questionnaire 
might look like is presented on the next page. 

Obviously, other forn.dts could be used for developing this type of visitor 
questionnaire. A good person to consult is. a graphic- arts specialist. 
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[ 



BUSINESS REPLY MAIL 

NO POSTAGE NECESSARY IF MAILED IN THE UNITED STATES 



POSTAGE WILL BE PAID BY 



[Name of Institution] 

[Address to Which Ouestionnaire 
is to be Returned] 



FIRST CLASS 
PERMIT NO. 
BOULDER. COLO. , 
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Outcome structure Category 21.131 g 



A-17 



Measure 
Number 



Measure Name 



Employee productivity as related. to college 



Definition 



Employer's reports of employee on-the-job economic productivity according to amount of 
college experience, for overall and by occupational /industry type 



Data Sources 



Community Employers 



Procedures 



Conduct interviews with employer officials and/br mail out employer questionnaires 



Uses 



Institutional 



State 



Comments 
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31.2300 

Outrome Structure Category 31.4200 

31.5100 

Measure Name 

Community participation in an institution's social, cultural, and recreational 
programs 

Definition 



The number of persons from the community who participate in social, cultural, and 
recreational activities organized and sponsored by an institution for its members 
and the general public during a specified period of time 



B-2 

Measure 
Number 



Data Sources 

Institutional records maintained by institutioifal departments or agencies sponsoring 
social, cultural, and recreational programs in which persons in the community 
participate 

Procedures 



Search of Institutional Records 



Uses 



Institutional 



State 



Comments 

T'^is measure was included in the original field review document and has been pilot-tested. 

It serves as a proxy measure of an institution's contribution to a community in the 
form of extramural, cultural, and recreational services. 
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QUESTIONNAIRE ITEMS FOR OUTCOME MEASURE B-2 

Data on public participation in the institution's social, cultural, and 
recreational activities can best be obtained by examining the records of 
the sponsors of such activities within the institution. For example, the 
offices of student government or student activities often maintain such 
records. The following procedural steps are suggested. 

Procedu res for Use of Institutional Records 

1. Identify the time period during which the extent of public 
participation in the institutjon's social, cultural, and 
recreational activities will be determined. 

2. Determine all the sponsors within the institution that have 
sponsored one or more social, cultural, and/or recreational 
activities within the designated period of time. 

3. Ask each sponsor to: 

a. Identify the type of activity (ies) offered (social, 
cultural, nr recreational). 

b. Estimate the number of community members who participated 
in each type of activity. 

4. For a descriptive summary of the data, list the estimated number 
of cotranunity participants in each type of activity sponsored 
during the time period in focus. 
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Outcome Structure Category 3L41io 



B-5 



Measure 
Number 



Measure Name 



Community use of institutional facilities 



Definition 



The number of persons from the community utilizing facilities maintained by the 
institution such as libraries, language labs, testing centers, computer centers, 
health services, recreation and athletic facilities, museums, and so forth - 



Data Sources 



Managers of the Institutional Facilities, Members of the Community 



Procedures 



Search of institutional records; Interviews; Administration of a questionnaire to 
members of the community 



Uses 



Institutional 



state 



Comments 



This measure \'as included in the original field review document and has been pilot-tested. 

It serves as a proxy measure of the extent to which individuals in the community 
receive various types of personal services from the support programs and facilities 
of the institution. 



.I45I57 



COMMUNITY FACILITY AND EVENT PROVISION MEASURES 



ACQUISITION PROCEDURES FOR OUTCOME MEASURE B-5 

The extent to which community members use the educational or support 
facilities in an institution can be determined by a questionnaire survey 
of a sample of the communtty populatio,-; and/or by a survey of facility 
managers. As a result, two alternative sets of questionnaire items and 
associated procedures were developed for obtaining data for this measure. 

Procedures for a Facility Use Questionnaire Survey 

Alternative #1— Survey of. Facility Managers: 

1. Select the time period duringf/ which the number of persons 
from the community using the institution's educational and 
support facilities wiM be determined. 

2. List the facilities that are to be included in the study. 

3. Identify the persons in charge of each facility (or who are 

in the best position to provide the information that is needed). 

4. Administer the following "Facility Use Questionnaire" to 
each of the persons identified in 3 above. If a person is 
responsible for more than one facility, that person should 
complete a separate questionnaire for each facility. 

Alternative #2— Survey of Community Members: 

The following questionnaire item is designed to obtain self-reports from 

persons in the community to two questions concerning facility use: 

(1) Do persons in the community krow about certain institutional facilities 
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FACILITY USE QUESTIONNAIRE 



The purpose of this short questionnaire is to help us deteri-nne the extent 
to which persons from the community make use of the facilities maintained 
by [Name of Institution]. Your cooperation in completing the questionnaire 
is most appreciated. Please return it to [Location] by [Date]. 



3. Address:^ 

4. Telephone Number: ij I 

5. Please fill in the following table by estimating, as best you can, the 
number of persons from the community who have used this facility or 
have attended certain events, activities, etc. held in the facility for 
which you are responsible during [Period of Time]. 



1. 



Your Name: 



2. 



Date: 



Official Name of Facility: 



Name or Description 
of Events or 
Activities 



Estimated 
Number of 
Community 
Attendees 



Please give a brief 
description of how 
you made your estimate. 
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being available to them? and (2) How many of those persons have used the 
facility or attended or participated in events held in the facility? In 
using this item, it will be necessary to develop a list of the individual 
f aci 1 i ti es (health centers, libraries, counsel ing-developmental centers, 
computer centers, gymnasiums, and so forth) to which persons will be asked 
to react in the survey. Also, it will be necessary to determine the 
time period in which the respondent will, identify if he or she used the 
f aci 1 i ty . 
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1. The purpose of this questionnaire item is to help us learn about the 
extent to which persons in the coninunity "know about" and "make use 
of" various facilities at [Name of Institution]. For each facility 
listed in the left-hand column, please answer questions "A" and "B." 



Name of 
Faci 1 i ty 


Question "A" 

Check (/) each box 
below if you were 
aware, prior to 
receiving this 
questionnaire, that 
the facility was 
open to the public. 


Question "B" - 

Check (/) each box 
below if'you have 
used or have attended 
or parti ci pa tea in an 
event at the facility 
during the last six 
months. 













































NOTE: The time period in Question"B" can be changed based on 
the purpose of your study. 
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Outcome Structure Category 31.4210 



c-2 



Pleasure 
Number 



Measure Name 



Enrollment of non-degree and nonrcertificate seeking students 



Definition 



The number of persons, who are not seeking a degree or certificate (nonmatriculating 
students), enrolled in regular credit-producing instructional programs or courses, 
as defined by subprograms 1.1 and 1.2 in the NCHEMS Program Classification Structure 
(PCS) 



Data Sources 



Institutional Student Records 



Procedures 



Search of Institutional Records 



Uses 



Institutional 



State 



Comments 

This measure was included in the original field review document and has been pilot-tested. 

It is a proxy measure of an institution's contribution to community educational 
development. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE -C^Z 



The data acquisition procedures developed for outcome measure C-2 are rela- 
tively straightforward in the sense that they require a single headcount of 
"nonmatriculating" students, that is, of those students who are not working 
toward a degree or a certificate, who are enrolled in credit-producing pro- 
grams or courses. The procedures suggest that the.NCHEMS Program Classification 
Structure (Collier 1978) be used to organize "the different credit-producing 
programs in which the "nonmatriculating students" are enrolled. 

Procedures for Use of Institutional Records 

f 

1. Determine the time period during which the number of 
non-degree and non-certificate seeking students enrolled 
in credit-producing instructional programs will be ascertained. 

2. Examine the individual student files and identify all 
"nonmatriculating students." 

3. i3r the students identified in 2 above, identify those who are 
enrolled in the PCS degree-related Instruction subprograms: 

1.1— General Academic Instruction 

1.2- -Vocational /Technical Instruction 

4. Next, for each PCS Subprogram and to the extent deemed appro- 
priate, disaggregate enrol lees by course subject matter category, 
course level, student level, and credit/noncredit status using 
institutions own coding or that specified in appendices A-C 
of the PCS (Collier 1978) 

5. For a descriptive summary of the data, total the number of "non- 
matriculating students** enrolled in each Subprogram Category of 

r Q the PCS. 
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Outcome structure Category 31.4210 



c-3 



Measure 
Number 



Measure Name 



Community participation in community education programs 



Definition 



The number of persons, whc are not seeking a degree or certificate (nonmatriculating 
students), enrolled in non-credit-producing instructional activities that are 
offered on or off campus 



Data Sources 



Institutional Student Records 



Procedures 



Search of Institutional Records 



Uses 



Institutional 



State 



Comments 

This measure was included in the original field review document and has been pilot-tested. 

It is a proxy measure of an institution's contribution to community educational 
development. 



ERIC 



-152- 

164 
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ACQUISITION P^ROCEDURES FOR OUTCOME MEASURE C-3 

The procedures for obtaining data for outcome measure C-3 require a simple head- 
count of those persons enrolled in those non-credit- p^"oducinc, instructional 
activities as defined by Subprograms 1,4, K5, 1.6, 1.7, and L8 (nondegree 
general studies, occupation-related instruction, social roles/iiteraction in- 
struction, home and family life instruction, and person J interest and leisure 
instruction, raspectively) in the revised Program Classification Structure 
( jllier 1978). A common term for such programs is Community Education, which 
was df^fined by ..oilier (1975) in an earlier version of the PCS as follows: 

Community Zdixation-rLS includes those instructional activities that are 
noncredit and are therefore not applicable towards a postsecondary degree 
or certificate. These instructional activities may be offered both on 
or off campus and may be taken by either matriculated students or members 
of the general comnum'ty. Any work that produces credit toward the 
high school diploma should be included in 1,4— Preparatory and Adult 
Basic Education. 

Examples of Community Education inclur^e: 

- Avocational Education (wine testing, great books, pa;nting, weavincj, 
guitar, child care, gardening, do-it-yourself, training pets, speed 
reading, recreational folk dancing, and so forth) 

- Adult Basic-Education Program 

- Professional Review or Refresher Courses 

- Citizenship and languages programs for persons seeking U,S, citizenship 
In the procedural steps that follow, a distinction is maue between matriculating 
students who are enrolled in such activities and nonmatriculating students who 
are t.irolled. 

P>X)cedures for Use of Institutional Records 

1, Determine the time period during which the number of persons 
participating in non-credit~producing Community Education 




COMMUNITY SERVICE PROVISION MEASURES 



instructional activities (gS defined by Subprograms 1.4-1.8 
the NCHEMS revised Program Classification Structure) will 
be ascertained. 

2. List all instructional activities that would be classified 
in ine PCS Subprograms 1.4-1.8 during the time per'od in 
focus. 

3. Examine the individual student files and identify the' 
matriculating students who have enrolled in ^ach Community 
Education activity identified in 2 above, and then the 
nonmatriculating students who have enrolled in each of 
those activities. 

4. The data should now be organized for outcome measure C-3. 



ERLC 



-154- 



i 
I 
I 
I 
I 
I 
I 
I 
I 
I 
I 
I 
I 
i 
I 
I 
I 
I 

ERIC 



COMMUNITY SERVICE PROVISION MEASURES 



3.3 Community Services 

Definition: This subprogram consists of resources, services, and exper- 
tise made available to persons and groups outside the context of the msti- 
tutions regular Instruction, Research, and support programs that are not 
included in subprograms 3.1, 3.2. 3.4, and 3.5. Community Services (3.3) 
activities differ from Cooperative Extension Services (3.4) in that 'hey are 
generally sponsored and controlled by the institution: extension services 
usually involve a sharing of programmatic and fiscal control with an out- 
side agency - • > • - . • 
• Provision of Faculty/Staff Services-Thqse activities designed to 
make faculty/staff/student knowledge and skills available to the com- 
munity or to groups external to the institution. The activities that should 
be classified in this category involve the use of the skills and Expertise of 
the institution's own.staff for purposes that are not part of the regular 
Instruction. Research, or support programs. This catesor; includes in- 
stitutionally sponsored consultii.g services and those insnuctional activi- 
ties that represent the provision of f*^iculty/s:aff resources outside the 
context of the Instruction program. 

Examples: Consulting with businesses, public school sy.^em, 
local governmental agencies 
I'rovision of coaches for community summer camp 
Faculty/staff participation on community-action 
committees 

Summer camps for high school students (eg., er- 

leader camps, music camps) 
Services related to the use of special equipment 

and facilities 
Public-servicc-rclatcd instructional activuies 
• Provision of Facilities/Equipment— I.icludes providing the insti- 
tution s physical facilities and/or equipment for community activities. 
Examples: Community meetings and events held in institu- 
tional facilities 
Community use of institutions gymnasium and rec- 
reation facilities for a summer camp 
- Provision of Cultural and Recreational Services— Those cultural 
and recreational programs arranged and sponsored outside the context 
of the Student Service program. (Cultural and recreational activities 
that arc conducted primarily for students as part of the Student Service 
program should be classified in subprogram 5.2. Social and Cultural 
Development ) 

Examples. Lecture and fine-arts series 

Concerts and recitals (visiting artists) 
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3.1 Direct Patient Care 

Definition: This subprogram includes those activities carried out for 
the specific purpose of providing direct patient care (prevention, diag- 
nosis, treatment, education, rehabilitation, and so forth) The provision of 
such care may be for the benefit of either humans or animals (veterinary 
care). In the postsecondary-education setting, these services are typically 
rendered under the auspices of a teaching hospital or health sciences 
center and are provided for the benefit of a clientele in the community- at- 
large rather than for the institution's own student body or faculty and 
staff. Patient-care a iivities carried cat solely for the benefit of the ins'ti- 
tution's students should be classified in subprogram 5.7, Student 
Health/Medical Services; patient-care activities carried out solely for 
faculty and staff should be classified in 6.5, Faculty and Staff Auxiliary 
Services. 

This subprogram includes only tnose activities directly related to the 
provision of patient care. In classifying the activities of a teaching hospital, 
one might look upon the hospital as a separate campus, thereby allowing 
for the use of all programs within the PCS. Thus, activities that are carried 
out within the setting of a teaching hospital^but that cannot legitimately be 
considered part of direct patient care (such as instruction, research, and 
administration) should be appropriately classified elsewhere. Instructional 
activities should be classified in the appropriate subprograms in the In- 
struction program, 1.0; research activities in the Research program, 2.0; 
administrative activities in the Institutional Administration program, 6.0. 
and physical-plant activities in the Physical Plant Operations program. 
7.0. Those health-care support services that are carried out in direct 
support of the provision of patient care, but that are not themselves a part 
of patient care, should be classified in subprogram 3 2. Health Care 
Support Services. 

Within the Direct Patient Care subprogram, two ways of further clas- 
sifying activities can be used, each independent of the other. On<? is to 
focus on the setting in which the paiieni-care functions are carried out (for 
example, inpatient, ambulatory, outreach, emergency). A second way is to 
look at the type of care being provided, such as medical/surgical, rehabili- 
tative, dental, or veterinary care. In fact, within each of these types of 
patient care a further disaggregation can be made by medical specialty 
(for example, pediatrics, obstetrics, dermatology). 

The following categories can be used for a more detailed classification of 
activities by setting: 

• Inpatient — Those activities designed to provide direct patient care 
within the confines of the care setting to persons who are residmg at least 
overnight on the premises. Typically, inpatient clients are considered 
those persons who are assigned a bed at the care facility. 

• Ambulatory — Those activities designed to provide direct patient 
care within the confines of the care setting to persons who are resident 
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neither overnight nor beyond the time required to provide the care Ex- 
cluded from this category is emergency patient care that is dchvered m 
an ambulatory setting. 

• Outreach— Those activities in which the patient-care piovider goes 
to the patient to deliver the care (such as a home-carc program). Ex- 
cluded from this third category is emergency patient care in which the 
care provider goes to the patient. 

• Emergency — Those activities designed to provide direct patient 
care to persons requiring immediate attention-due to the acute nature of 
their health-care problem. 

• Mixed Function — Those activities that are a-combmation of 
several of those described above so that the individual activities cannot 
be separated and classified in the appropriate categories. If the indi- 
vidual component parts can be, separately identified, however, they 
should be classified in the appropriate categories. 

The following categories can be used for a more detailed classification 
by type of care: ^ 

• Medical/Surgical Care— Those activities related to preventing, 
caring for, and assisting in the cure of disease and the care of the injured 
as well as surgical functions. 

• Behavioral — Those activities related to the treatment of psycho- 
logical and behavioral problems as well as to the promotion of psycho- 
logical well-being. 

• Rehabilitative Care — Those activities related 'o the restoration of 
bodily functions and s ructurcs in order to regain patient self 
sufficiency. 

• Public/Community Medicine — Those activities related to the 
health and illness of populations. 

• Patient Education — Those activities carrud out to provide 
patients with the knowledge and atti udcs needed to cope effectively 
with their own health problems. 

• Dentul Care — Those activities related to care and treatment of 
human teeth and structures. 

• Veterinary Care — 1 hose activities pertaining to the care and treat 
ment of animals and their diseases 

• Supportive Care — Those activities related to conducting pre 
scribed treatment plans and to supporting the implementatiop of those 
plans (for example, patient hygiene, observation of patient status) 

« Other Patient Care 
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3.2 Health Care Supportive Services 

Definition: This subprogram includes those activities that are unique to 
a teaching hospital, health-sciences center, or clinic and that directly 
suppo-t the provision of health care but that cannot themselves legiti- 
mately be considered part of the provision of direct patient care. The 
following categories should be used for a more detailed classification of- 
activities withir this subprogram: 

• Medical Support Services — Those activities that are medical in 
nature and that indirectly support patient care. bat are not actually pan 
of the provision of direct patient care. 

Examples: Blood bank - 

Dietary anc. nutiitional services (unless part of the 

p^ti treatment) 
EEC 
EKG 

Optical services 
Pharmacy 

Physiological instrumentation and monitoring 
X-ray services 

• General Hospital/Clinic Support — Those administrative and 
support activities that are unique to the operation of a hospital or medi- 
cal clinic. Excluded from this category are those administrative activities 
that can be classified appropriately withm the various subprograms of 
the Institutional Administration program (6.0). 

Examples: Admitting and credit 
Forensic medicine 
Medical records 
Patient charging and accounts 
Inpatient reception desk 

• Retail Services and Concessions — Those activities provided as a 
comfort or convenience to the visitors and clientele of the hospital or 
cli nic. These activities are often operated as income-generatmg or self- 
supporting enterprises. 

Examples. Gift shop 

Social services 
Television-rental services 
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Outcome Structure Category 31.4200 



c-4 



Measure 
Number 



Measure Name 



Community participation in cooperative extension services 



Definition 



The number of persons from the community who have participated in cooperative extension 
service activities as defined by Subprogram 3.3 in the NCHEMS Program Classification 
Structure (PCS) 



Data Sources 

Institutional records maintained in the office i/'esponsible for cooperative extension 
service activities 



Procedures 



Search of institutional records 




Comments 

This measure was included in the original field review document and has been pilot tested. 

It is a proxy measure of the extent to which the community receives direct assistance 
and services of various types from the primary programs of the institution. 



COMMUNITY SERVICE PROVISION MEASURES 



ACQUISITION PROCEDURES FOR OUTCOME MEASURE C-4 



This outccme measure represents one indicator of the impact the institution 

and its programs have on the coiranunity. "Cooperative extension services", 

as defined by the NCHEMS Program Classification Structure (Collier 1978) are: 

Cooperative Extension Service (subprogram 3.4; includes those activities 
that make resources, services, and expertise available outside the 
Instruction, Research, and support programs and that are conducted as 
cooperative efforts with outside agencies. (Note: This category 
includes only those extension services that are considered to be public 
service; it should not be used to classify the entire extension division 
of the institution.) Excluded from this subprogram are those instruc- 
tional and research activities offered through an extension division. 
A distinguishing feature of the activities included in this sub- 
program is that prograninatic arid fiscal control are u'^ually shared with 
one or more external' agencies or governmental units. 

f 

Procedures for Use of Institutional Records 



1. Identify the time period during which the number of community 
members participating in Cooperative Extension Services activities 
(PCS Subprogram 3,4) will be determined. 

2. List all the Cooperative Extension Service programs that have 
been available to members of the general community during the 
period of time 1n Tocus. 



3. Identify the number of participants in each program. (Do not 
include persons who participate in these programs for purposes 
of seeking credit toward a degree or certificate.) 

4. For a descriptive summary of the data, list the total number of 
community participants for each cooperative extension service 
program offered during the period of time in focus. 



ERLC 



-160- 

172 



COMMUNITY SERVICE PROVISION MEASURES 



Outcome Structure Category 31.2000 



C-5 

Measure 
Number 



Measure Name 



Educational goals achieve?! by community participants 



Definition 



The degree of perceived personal improvement and satisfaction with respect to 
job promotion and salary, increase, development of technical skills, leadership 
and human relations, and other personal attributes among community participants 
in institutional programs 



Data Sources 



Persons in the community who have participated in specific educational programs 
on and/or off campus 



Procedures 



Interviews; Administration of a Survey Questionnaire 



Uses 



Institutional 



Comments 



State 



This measure was included in the original field review document, and has been pilot 
tested. It represents a community counterpart of many of the student measures in 
this Manual. Instead of measuring the dimensions of student growth and development, 
however, the above outcome measure is aimed at measuring the growth and development 
of those persons who come into contact with the institution and its programs but 
are not seeking a degree or certificate. 
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QUESTIONNAIRE ITEMS FOR OUTCOME MEASURE C-5 



One procedure recommended for obtaining data for outcome measure C-5 
requires the development and use of a surv j questionnaire. 



Procedures for a Questionnaire of Community Members Taking Courses 



Tht fonowin9 questlonnalr* Item art Intended to learn If the edu- 
cational actlvuies in Mhich you oartlciPatcd at [Nant of Institution] 
helped you achieve your educational goals. 

1. Please identify the n.int of the educational pro9ram (or courses) 
In which you participated during (Period of tine). 



2. Whicn of the following statements best describe your reasons for 
partlclpatlio In the above pro5ran(s)? Please check (^) all that 
apply. Also', Indicate to the right of those statements you have 
Checked the extent to which your expectations were realized as a 
result of your Involvement. 





(1) 
Very 

Much 


(2) 
Quite 
A Bit 


(3) 
Some- 
what 


(4) 
Not 
At All 


□«') 


To Increase iny chances to 
qualify for a new job or 
occupation. 










□ (2) 


To enhance my chances for 
a possible i crease In 
salary and/or possible 
job promotion. 










Q3) 


To Improve my human rela- 
tions skills and/or leader- 
ship skills. 










□(4) 


To Improve iny knowledge amj 
technical skills required 
In iny work. 










QS) 


To Improve my General know< 
ledge and skills for 
personal satisfaction. 










□««) 


To have a personal ex- 
perience with the 
academic world. 










□(7) 


Other (Please specify) 











3. In reflecting upon your experiences In these programs, would you 
recottwend them to a fnend or a relative who Is In a situation 
kinllar to yours? 

{}) Otflnltely yes 

{X\ Probably yes 

( 3) Probably not 

iJK\ Definitely not 
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31.2330 

Outcome Structure Category 31.2440 

31.4210 

Measure Name 

Community awareness and use of, and satisfaction with instructional programs 

Definition 

The degree of awareness and use of, and the satisfaction with instructional programs, 
demonstrated by members of the community 



C-6 

Measure 
Number 



Data Sources 



Persons in the local community 



Procedures 



Interviews; Administration of a survey questionnaire 



Uses 



Institutional 



State 



Comments 



Although this measure was not_ included in the original field review document, it has 
been pilot tested. 

This measure was used as part of the development of the Community Impact Study Hand- 
book for Community Colleges . 
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QUESTIONNAIRE ITEMS FOR OUTCOME MEASURE C-6 

One procedure recommended for obtaining data for outcome measure C-6 re- 
quires the administration of a survey instrument similar to the one below. 



1 . 


(Name of Institution) offers several types of educa- 
tional programs. Please check (vO each program area 
you were aware of before reading this questionnaire. 




□ (1) 


Skill training and upgrading programs 




□ (2) 


College transfer courses and programs 




□ (3) 


Career and occupational courses and programs 




□ (4) 


General academic courses and programs 




□ (5) 


Was not .aware of these programs 




(List of programs would be developed by inst1tution--what 
appears above is a sample.) 


2 . 


Have you 


enrolled in any of the programs listed below? 




□ (1) 


I have not enrolled in any program. 




□ (2) 


Skill training and upgrading program 




□ (3) 


College transfer courses and programs 




□ (4) 


Career and occupational courses and programs 




□ (5) 


General academic courses and programs 


3. 


How satisfied were you with your educational experiences 
at (Name of Institution)? 




□ (1) 


I have had no educational experiences at (Name 
of Institution) . 




□ (2) 


Completely dissatisfied 




□ (3) 


Dissatisfied 




□ (4) 


Neutral 




□ (5) 


Satisfied 




□ (6) 


Completely satisfied 
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3i.2330 

Outcome Structure Category 31.2440 

31.4200 



c-7 



"Measure 
Number 



Measure Name 



Community awareness and use of. aod satisfaction with assistance services 



Definition 



The degree of satisfaction experessed by members of the community concerning assistance 
services provided by the Institution 



Data Sources 



Persons living in the community; Managers of Institutional Services 



Procedures 



Interviews; Adminstration of a questionnaire to members of the community; a search of 
institutional records 



Uses 



Institutional 



State 



Comments 



bLToifof^ip.tPH'^lhr T ^'"'^"^'^ ^^'^Id '^'^^^ document, it has 

" '^^^^^^^'^ ^^^^ -asure^^Tb?^ 



considered a 



HandbSof ^o" "L^^?^.'^.nf?:; r ^^"^^"^"-^ °f Co^unity In,pact study 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE C-7 

The extent to which community members use educational or support services in an 
institution can be determined by an institutional record search, telephone or in- 
person interviews (for example, at a shopping center), of samples of community 
members, or by administering a questionnaire to members of the community. Surveying 
the community also provides information concerning awareness of and satisfaction 
with the services. The two alternative procedures for obtaining data for this 
measure are: 

1. Record Search (Survey of Service Managers) 

1. Select the time period during which the number of persons 
from the community using the institution's educational 
and support services will be determined, 

2. List the services to be included in tha study, 

3. Identify the persons in charge of each service--the 
person in the best position to provide the needed infor- 
mation. 

4. Administer the "Service Use Questionnaire." 

II. Survey of Community Members 

The questionnaire items on the following page are designed to 
obtain self-reports from persons in the community to three 
questions concerning service use: 

• Do persons in tht community know about certain 
institutional services? 

• Do persons in the community use institutional 
services? 

• Are persons who use institutional services satisfied? 
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SERVICE u:e questionnaire 

The purpose of this short questionniare is to help js determine the 
extent to which persons from the community make use of the servi :s 
maintained by (Naiiie of Institution). Your cooperation in completing 
the questionnaire is most appreciated. Please return it to (Location) 
by (Date), 

U Your Name: 2, Date: 



3, Address: 



4. Telephone Number: ^ ^ 

5. Flease fill in the following table by estimating, as best you can, 
the number of persons from the community v/ho have used this service 
for ',!:TCh you are responsible during (Period of Time), 



Official Name of Service: ^ 


Name or Description of 
Events or Acti vi lies 


Estimated Number of 
Community Attendees 


Please give a brief 
description of how you 
made your estimate 


'• 

1 
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4. Listed below are a number of services which are viev/ed by (flame 
of Institution) as being of potential use to various members of 
the community. 

For each service listed below, please indicate: 

1 . ) Your awareness of the service. 

2. ) If you have used the service. 

3. ) Your satisfaction with t ? service if used . 



SERVICE 


Are you aware 
of this 
service? 


Have you used 
it? 


Were you 
satisfied-- 
if used? 




Yes 


Mo 


Yes 


No 


Yes 


flo 


1. 


n 


It- 

r 

u 


□ 


□ 


□ 


□ 


2. 


□ 


□ 


□ 


□ 


□ 


□ 


3. 


□ 


□ 


□ 


□ 


□ 


□ 


4. 


□ 


□ 


□ 


□ 


□ 


□ 


5. 


□ 


□ 


□ 


□ 


□ 


□ 
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Sub-communities that might be surveyed include: 

• Registered voters 

• Other educators in the community 

• Social agency leaders 

• Civic leaders 

• Faculty/staff of the institution 

• .Employers in the community 
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Outcome Structure Category 31.2110 

31.2440 



C-8 



Measure 
Number 



Measure Name 



Community unmet educational needs . 



Definition 



The perceptions of people in the community concerning needs that the institution 
is not meeting, but should' be attempting to meet 



Data Sources 



Persons in the local community 



Proceudres 



Interviews; Administration of a survey questionnaire 



Uses 



Institutional 



Comments 



state 



Although this measure was not included in the original field review document, it has 
been pilot tested, 

This is a measure of the degree and numbar of unmet educational needs in the community 
tnat the institu.ion might meet. 

This measure was used as part of the development of the Community Impact Study Handbook 
Jn r Community Colleges . 
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- QUESTIONNAIRE ITEMS FOR OUTCOME MEASURE C-8 

The extent to which community members perceive unmet needs in the community 
that the institution is not meeting, but could be meeting, can be obtained 
by a questionnaire sur\/ey. Some of the sub-communities that might be surveyed 
incl ude: 

t Registered voters 

t Otner educators in the community 

t Social agency leaders 

t Civic leaders 

t Faculty/staff of the institution 
t Employers in thfe community 

The following questionnaire item is designed to gather appropriate informa- 
tion. 



Are there educational needs in the community you feel (Name 
of Institution) should be attempting to meet, but is not 
meeting at the present time? 

□ (1) Yes 

□ (2) No 



If yes, what are they? 



r ^ 
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31.2110 

Outcome Structure Category 31.2330 

31.2730 



Measure Name 



Institutional goal attainment 



Definition 



The degree of satisfaction expressed by members of the community as to how well 
the institution is achieving its goal(s) 



C-13 

Measure 
Number 



Data Sources 



Persons in the local community 



Procedures 



Interviews; Administration of a survey questionnaire 



Uses 



Institutional 



State 



Comments 



Although this measure was not included in the original field review document, it has 
been pilot tested. 

This measure was used as part of the development of the Community Impact Study Handbook 
fc r Community Colleges . 
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QUESTIONNAIk£ ITEMS FOR OUTCOME MEASURE C-13 

The extent to which commun' cy members perceive the institution is achieving 
its states goa1(s) can be obtained by a questionnaire survey. Some of the 
subcommuni ties that might be surveyed include: 

• Registered voters 

• Other educators in the communicy 

• Social agency leaders • 
§ Civic leaders 

• Faculty/staff of the institution 

• Employers in the community 

The following questionnaire Item is designed to gather appropriate percep- 
tions^ 



ABO UT (NAME OF INSTITUTION) 

The overall purpose of (Name of Institution) ^s to provide 
educaziorjil programs and services as needed by the residents 
of the comunity beyond the high school levels The educatiorz 
and training provided by (Name of Institution) are intended 
to help students obtain the knowledge and skills needed for 
educational and occupational career advancement^ personal 
development^ and recrea'^ional development. 

Given this overall purpose of (Name of Institution), how well 
do you feel (Name of Institution) is achieving this goal? 



□ 


(1) 


Very poor job 


□ 


(2) 


Less than satisfactory job 


□ 


(3) 


Satisfactory job 


□ 


(4) 


More than satisfactory job 


□ 


(5) 


Excellent job 
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Outcome structure Category 22.3300 



D-l 



Measure 
Number 



Measure Name 



Research proposals funded 



Definition 



Number and percentage of research proposals that were funded within a certain time 
period, by PCS subprogram,. annual level of funding and duration of funding 



Data Sources 



Institutional Research Contracts Officer or Faculty/Staff 



Procedures 



Search of institutional records 



Uses 



Comments 




This measure was included in the original field review document. It is a proxy meastre 
of the discovery, interpretation, and application of new knowledge. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE . D^l 

The procedural steps recommended for obtaining data for outcome measure 
D-i' require the use of institutional records that contain information about 
research proposals that have been acted upon and funded by various funding 
sources. A proposal is defined as acted upon once it has been submitted 
to a funding organization and the f under. has made a decision to fund or 
not fund the proposal. Nomally, this information can be collected fro:n 
an institution's office for grants and contracts. If such an office does not 
exist, a survey of the heads of academic departments and research centers 

in the institution will need to be conducted to obtain the data necessary 

H 

for deriving this measure. Once the appropriate data source is determined, 
the following steps can be implemented: 

1. Specify the time period for which the measure will be 
derived (for example, fiscal year). 

2. For each organizational unit within subprograms 2.1 — Institutes 
and Research Centers and 2.2— Individual or Project Research of 
the NCHEMS revised Pr ogram Classification Structure (PCS), 
identify the number of research proposals that have been 
acted upon by funders in the specified time period. 

3. For each proposal that was a cted upon identify: 

a. The requested '^evel of total funding. 

b. The req>iested duration of funding using the following 
categories: 
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(1) less than 1 year 

(2) 1-3 years 

(3) More than 3 years 

c. Whether or no' the proposal was funded. 

4. For each acted upon proposal that was funded identify: 

a. The actual level of funding; 

b. The actual duration of funding. 

5. Data should now be available for determining the number of 
proposals funded as a percentage of proposals acted upon, by 
PCS 2.0 sub-program categories, level of funding, and duration 
of funding. 
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Outcome Structure Cacegory 22.3300 



D-2 

Measure 
Number 



Measure Nome 



Research restricted revenues 



Definition 



Total research restricted revenues as a percentage of the total budget, 
by PCS program activity center and by source of revenues 



Data Sourc3s 



Institutional Budget Officer 



Procedures 



Search of institutional records 



Uses 



Institutional 



State 



Comments 



This measure was included in the original field review document. It is a proxy measure 
of the discovery, interpretation, and application of new knowledge. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE D-2 

The procedural steps recommended for obtaining data for outcome measure D-2 
call for the use of institutional records concerning re\.nues received by 
the research program activity centers in the institution. The data neces- 
sary for deriving -this measure should be available in the institution's 
business office or in the office for grants and contracts • 

The following steps are used for deriving data for measure 10-2 

1. Specify the time period for which the measure will be 
derived (for example, the academic year), 

2, For each organizational unit within subprograms 2.1 — Institutes 
and Research Centers and 2 •2— Individual or Project Research of 
the NCHEMS revised Program Classification Structure , identify the 
total restricted current fund revenues expended from the following 
source categories: 

a. Governmental Grants and Contracts: 

(1) Federal 

(2) State 

(3) Local 

L. Private Gifts, Grants, and Contracts. 

The following data display format can be used for organizing the revenue data 
(where the last four digits of the code numbers refer to Hegis categories): 
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2.0 RES ARCH 

PROGRAM CATEGORIES 


SOURCE OF REVENUES (Restricted) 


Government Grants & Contracts 


Private 
Gifts, 
Grants & 
Contracts 


Total 


Federal 


State 


Local 


2.1 Institutes & Research 'enters 
2.1.0100 

2.1 .0200 NOTE: Refer to 

Appendix C for a com- 
plete listing of the 
HEGIS disciplines. 

2.1.5500 
2.1.9200 

2.2 Individual or Project Research 
2.2.0100 

2.2.0200 NOTE: Refer to 

Appendix C for a com- 
plete listing of the 
HEGIS disciplines. 

2.2.5500 
2.2.9200 


li 











3. Identify total budget for each organizational unit in sub- 
programs 2.1 and 2.2 of the PCS. 

4. Once step 3 is completed, the total restricted revenues expended 
as a percentage of the total budget for the designated time 
period can be calculated for each organizational unit associated 
with 2.1 and 2.2 of the PCS. 
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Outcome structure Category 12.2750 



F-l 



Measure 
Number 



I 
I 



Measure Name 



student success in obtaining first job after leaving the institution 



Definition 



Number and percentage of students (graduates and nongraduates) who are employed 
within a certain time period after leaving the institution 



Data Sources 



Exiting Students, Former Students 



Procedures 



Interviews; Administration of a survey questionnaire 



Uses 



Institutional 



State 



CoTiments 



This measure was included in the original field review document, and has been pilot 
tested. 
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- QUESTIONNAIRE ITEMS FOR OUTCOME MEASURE F-1 



One of the alternative procedures recommended for obtaining data for outcome 
measure F-1 is the use of a survey questionnaire. Two sets of items are pro- 
vided here, one for use in an existing-students questionnaire and one for use 
in a former-students questionnaire. In each case, several items have been 
included to gain the respondents' preceptions about (1) how they regard this 
job, (2) how they found it, and (3) its linkage to their major field of study. 
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C.iestionnaire iteitis for an EXlTlflG-STUDENT Questionnaire 



o ■ 

ERIC 



Oo you currently hold or have you secured a 
a fuU-tine job (35 hours or more per week) 
tn which you plan to work once you complete 
your studies at (Name of Institution)? 

(1) Yes (GO TO QUESTION 2) 

(2) No (SKIP TO QUESTION 11) 

For whom do you (or will you) work? (Name 
of employing firm) 



C1ty_ 



_State ^Z1p_ 



3. What kind of business or Industry is the 
job in' (For example, accounting ^irm, 
public school. TV manufacturer) 



4. What kind of work does the job Involve? 
(For example, accounting, teaching, 
electrical engineering, welding) 



5. Are you (or will you be): 

(1) An employee of a private business? 

(2) Self-employed in your own business? 

(3) An employee of local^ state or 

federal government? 

(4) A public employee of a non- 
governmental organization? (For 
example, an environmental agency) 

6. Which statement best describes how you re- 
garded you firs t full-time job? (Check one) 

(1) Employment with definite career 
potential 

.wl Employment with possible career 

potential 

(3) Employment to earn money while I 

decided what kind of work I wanted 

(4) Temporary employment to earn money 

to do something else (tr^^vel, school, 
have free tinje, etc. ) 

(5) Temporary employment until something 

better could be found. 

7. How did you learn of this <ob: (Check 
Primary source ) 

(1) Was already working in it while 

enrol led 

(2) College placement office 

(3) Professional organization or 

journal 

(4) Public or private employment agency 

(5) Newspaper advertisement 

(6) Direct application to employer 

(7) Faculty referral 

(8) Referral through friend or relative 

(9) Other (please specify) 



8 To what extent was this job related to the j 
major/program you were enrolled in at our 
school? (Check one) 

(1) Not related 

(2) Somewhat related 

(3) Directly related 

9. If you answered 1 or 2 for Item 8, please check 
from the list beluw the principal reason why 
yOur current job is not in your major/program. 

(1) I never looked for a ^ob related to 

my major/program. 

(2) I looked, but could not find a job 

related to my major/program witnout 
moving out of the geographic are^. 

(3) I looked, bet could not find a job 

related to my major/program even in 
other geograpnic areas. 

(4)- I have held a job related to my 

major/program, but decided to get 
into a new employment field. 

10. How well do you feel our school prepared 
you for this job? (Check one) 

(1) Inadequate preparation 

(2) Fair preparation 

(3) Good preparation 

(4) Excellent preparation 

(NOW GO TO QUESTION ) 



11. 



12, 



13. 



/re you currently seeking or planning to 
seek (within 6 months) a full-time job 
(35 hours or more a week)? 

(1) Yes (GO TO QUESTION 10) 

(2) No (SKIP TO QUESTION ) 



In what kind of business or industry is 

the job you are (or will be) seeking'? 

(For example, accounting firm, puolic 
school, TV manufacturer) 



What kind of work do you exoect to do on 
the job you are (or will be) seeking? 
(For example, accounting, teaching, 
electrical engineering, welding) 
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Questionnaire Items for a FORMER-STUDENT Questionnaire 
oe limited to graduates, change the work "leaving" to 
as appropriate) 



(If the questionnaire is to 
'graduating" or "graduation" 



1. Have you held a fuU-tifre job (35 
hours or more per week) since leaving 
our school? (Check one) 

(1) Yes (SKIP TO QUESTION 4) 

(2) No (GO TO QUESTION 2) 



Have you sought or do you plan to seek 
(within 6 months), a full-time job 
since leaving (Name of Institution)? 

(1) Yes (GO TO QUESTION 3) 

(2) No (SKIP TO QUESTION^) 

What was the major reason you have not 
obtained a job since leaving (Name of 
Institution)? 

(1) I only tried to find a job recently 

(2) I have not been able to find a job 

related to my major field of 
study 

(3) I have not been able to find a job 

for which I could qualify 

(4) I interviewed for jobs for which 

I qualify, but was not hired 

(5) Other reason (please specify) 



How long after leaving school did it take 
you to find your first full-time job? 



(1) 


I had the job before leaving 


(2) 


2 months or 


1 -S 


(3) 


3-6 months 




(4) 


7 months to 


1 year 


(5) 


over 1 year 




What was (or is) the 
your first full-time 
employing firm. ) 


name and address of 
enployer? (Name of 


City 




State Zip 



6. What kind of business or Industry was 
(or is) ycjr first job in' (For 
example, accounting firm, public school, 
TV manufacturer) 



7 What kind of work did (or does) your 
fi rst job involve? (For example, 
accounting, teaching, electrical engineer- 
ing, welding) 



8. In your first full-time job after leaving 
(Name of Institution), were you (or are 
you). 

(1) An employee of a private business? 

(2) Self-employed in your own business? 

(j) An employee of local, state, or 

federal government? 

(4) A public employee of a nongovernmental 

organization' (For example, an en- 
vironmental agency, a public school 
system) 

9. Which statement best describes how you regarded 
yo"'' '^lyyt full-time jot? (Check one) 

(1) Employment with definite career 

potential 

(2) Employment with possible career 

potential 

(3) Employment to earn money while I 

decide what kind of work I wanted 

(^) Temporary employment to earn money to 

do something else (travel, school, 
have free time, etc.) 

(5) Temporary employment until something 

better could be found 

10. How did you learn of this job: (Check 
primary source) 

(1) Was already working in it while 

enrol led 

(2) College placement office 

(3) Professional organization or ' 

journal 

(4) Public or private employment 

agency 

(5) Newspaper advertisement 

(6) Direct application to employer 

(7) Faculty referral 

(8) Referral through friend or 

relative 

(9) Othpr (please specify) 
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The open-end questionnaire items in the procedures above have been used by 
the U.S. Bureau of Census to determine the employment sector and the kind 
01* work in which a person is involved. They have been suggested here since 
they have the advantage of allowing the respondent to provide his or her 
own answer and obtaining responses that can be compared to the data the 
Bureau of Census collects in its annual educational attainment survey, which 
is conducted each March. (See U.S. Bureau of Census,. Current Population 
Reports : Series P-20, "Educational Attainment in the United States.") 
However, the open-end items have the disadvantage of requiring the data 
processor either to code the responses using the Bureau of Census' cate- 
gories, which are quite detailed, or to develop his or her own categories 
for coding purposes* 

As an alternative, the following closed-end questionnaire items are suggested 
as possible replacements for items 3, 4, and 5 in the EXITING STUDENT Ques- 
tionnaire procedure and Items 6, 7, and 8 tn the FORMER-STUDENT Questionnaire 
procedure. The occupations coded in Item 2 below can come from the list of 
Aooendlx B or another cateaorization of the insti tutinn*<; chnnsinn. 

r ^ ' 1 

I 

1. In which of the following employment sectors was this job? 
(Check onej 

I I (1) Government 

( I (2) Education 

I I (3) Other nonprofit organizations 

I I (4) Business and service 

2. From the list that appears on page , which entry best describes the 

full-time occupation in which you are (or will be) employed? (Please 
write its 2-dig1t code in the space below.) 

Occupation: | I I 
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1. In which of the following employment sectors was this job? (Check one) 
I I (1) Government 

I I (2) Education 

I [ (3) Other nonprofit organizations 

I I (4) Business and service 

2. How much of the work in this first full-time job v/as devoted to the 
following activities? (CHECKUnTTOR EACH ACTIVITY) 





(1) 
A Major 
Amount 


(2) 
A Minor 
Amount 


(3) 
None 


A. Teaching 








B. Research and Development 








C. Administration or Management 








D. Service to Patients or Clients 








E. Other (please specify) 









3. Was your first full-time job after leaving (Name of Institution) the 
job you most preferred at the time? 

□ (1) Yes 

□ (2) No 
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Outcome structure Category 12.2750 



F-2 



Measure 
Number 



Measure Name 



student success in obtaining preferred first job 



Definition 



Number and percentage of students who received the job of their first choice upon 
leaving the institution 



Data Sources 



Former students 



Procedures 



Telephone interview; administration of a survey questionnaire 



Uses 



Institutional 



State 



Comments 



This measure was included in the first field review document and has been pilot tested. 
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QUESTIONNAIRE ITEMS FOR OUTCOME MEASURE F-2 



One procedure for the acquisition of data for outcome measure F-2 
is the use of a survey questionnaire. Because of the nature of the 
measure, the procedures are only appropriate for use in a FORMER-STUDENT 
Questionnaire. 

Items for a FORMER-STUDENT Questionngire 

It should be noted that questionnaire items 1 and 2 below are suggested 
since they are comparable to those used in the American Council on Edu- 



cation's longitudinal follow-up studies of college students. As a result, 
the results obtained from the use of these items can be compared to the 
ACE results referenced in Preventing College Dropouts (Astin, 1975) or 
by writing to Dr. Alexander Astin, Graduate School of Education, Univer- 
sity of California at Los Angeles, California. 



-137- 



199 



STUDENT ECONOMIC ACCESS AND INDEPENDENCl^ MEASURES 



4 


Which statement best describes how you regarded your first 




fun 


-time job? (Check one) 




□ 


(1) 


Employment with deftmte career potential 






(2) 


Employment with possible career potential 




□ 


(3) 


. Employment to earn money while I decided what 








kind of work I wanted 




i 1 


(4) 


Temporary eiroloyment to earn money to do 








something else (travel, school, have free time, 








etc . ) * . 




y 


(5) 


Temporary employment until something better 








could be found 


5. 


How 


did you learn of this job: (Check primary source) 




n 


(1) 


Was already working in it while enrolled 




□ 


(2) 


College placement office 




□ 


(3) 


Professional organization or journal 




a 


(4) 


Public or private employment agency 




□ 


(5) 


Newspaper advertisement 




□ 


(6) 


Direct application to employer 




n 


(7) 


Faculty referral 






(8) 


Referral through friend or relative 




□ 


(9) 


Other (please specify) 


6. 


To what extent is your current job related to the major/ 




program you were enrolled in at our college? (Check one) 




□ 


(1) 


Current job is not related to my major/program 




□ 


(2) 


Current job is somewhat related to my major/- 








progra.D 




□ 


(3) 


Current job is specifically what I was trained 






for in my major/program 
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As an alternative to questionnaire items 1 and 2 above, one may wish to consider 
the following thres questions which have been used by the U.S. Bureau of Census 
to determine the employment sector and kind of work a person is doing or has 
done. Responses to these questions and those pertaining to questions 4, 5, and 
6 above can be compared to data the Bureau of Census collects in its annual edu- 
cational attainment survey which is conducted each March. (See U.S. Bureau of 
Census, Current population Reports: Series P-20, "Educational Attainment in 
the United States.") The occupations coded in » Items 1 and 2 below can 
come from the list of Appendix B or another categorization of the insti- 
tution's choosing. 

1. In what kind of business or industrAr was (or is) your f^rst full-time 
job after leaving (Name of Institution)? (For example, accounting 
firm, public school, TV manufacturer) 

i \ f 

2. What kind of work did (or does) your first full-time job involve? (For 
example, accounting, teaching chemistry, electrical engineering) 

I I ! 

3. In your first job were you (or are you): 

I |(1) An employee of a private business? 

I |(2) Self-employed in your own business? 

[~](3) An employee in local, state, or federal government? 

I ][') A public employee in a nongovernment organization: (For example, 
— an environmental agency, a public school system, a public hospital) 
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Another a cernative for questionnaire items 1 and 2 above is the 
followinv^ 

!• From the list that appears on page , which entry best describes 

your first full-time occupation after leaving (Name of Institution)? 
(Please write its 2-digit code in the space below.) 

Occupation: | j | ^ 



if 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE F-3 

Two alternative procedures are suggested for identifying the level of 
earnings of exiting or former students on their first job after leaving 
the institution. Both require the use of a survey questionnaire. 

The fir?t alternative uses an open-end question to obtain the data needed 
to de'^ive this measure. Its advantages include (1) a precise identification 
of the respondent's actual earnings on his or her first job, and (2) data 
that are very conducive to statistical analysis since they can easily be 
computed into a mean or median amount of earnings. 

The second alternative incorporates a closed-end approach. The major advan- 
tage of this alternative is that categories are already available for quick 
and easy analysis. 

Procedures for an EXITING-STUDENT or FORMER-STUDENT Questionnaire 
[SEE FOLLOWING PAGE] 
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Alternative 



In your first full-time job (35 hours or more a week) after 
leaving (Name of Institution), what is (or was) your gross salary 
or wage? (PLEASE FILL IN ONE) 



(1) 
(2) 
(3) 
(4) 



(check) 



per year 
per week 
per he ' 
Don't know 



Alternative #2 



1. What \/as the smarting annual salary or wage you received on your 
first full-time job? (Check one) 

I i (1) Less than $3,000 per year ($1.44 or less per hour) 
□ (2) $3,000 - $5,999 per year ($1.45 - $2.88 per hour) 
I I (3) $6,000 - $7,499 per year ($2.89 - $3.50 per hour) 

I I (4) $7,500 - $9,999 per year ($3.61 - $4.80 per hour) 

I \ (5) $10,000 - $14,999 per year ($4.81 - $7.21 per hour) 

I I (6) $15,000 - $24,999 per year ($7.22 - $12.01 per hour) 

I I (7) $25,000 and above per year ($12.02 or more pe»- hour) 
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OUCSTIONNAIRE ITEMS FOR OUTCOME MEASURE F-4 

The procedure developed for obtaining data for outcome measure F-4,' Annual 
Total Income of Former Students, calls for the use of a survey questionnaire. 
The questionnaire items recommended for use in this procedure are 
designed to determine not'only the respondent's annual salary, but also the 
total amount of dollars he or sne has at his or her- disposal at this time. 

Procedure for a FORMER-STUDENT Questionnaire • 

[SEE FOLLOWING PAGE] 
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Alternative #1 



L What is the annual salary or weekly wage ,^ou earn in your current 
job? (PLEASE FILL IN ONE) 

$ (1) Per year 

$ (2) Per week 

$ (3) Per hour 

(4) Not currently employed 

(check) 



2. If you are married and your spouse is employed, what is -the approx- 
imate annual salary or weekly wage your spouse earns in his or her 
current job? (PLEASE FILL IN ONE) 

$ (1) Per year 

$ (2)- Per week 

$ (3) Per hour ^ 

(4) Not currently employed 

(check) 



3. What is your current estimated annual income from other sources 
--Siuch as interest earned from savings accounts and profits from 
rental properties? (Pleas? write in your estima+e in the space 
below. ) 

Income ^^om other sources = $ /year 
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1. Approximately what is the annual salary or weekly wage you earn 
in your current job? (PLEASE CHECK ONE) 

Q (01) Less than $3,000 per year (less than $58 per week) 

□ (02) $3,000 - $5,999 per year ($58 - $114 per week) 

□ (03) $6,000 - $8,999 per year ($115 - $172 per week) 

□ (04) $9,000 - $11,999 per year ($173 - $230 per week) 

□ (05) $12,000 - $14,999 per year ($231 - $287 per week) 

□ (06) $15,000 - $17,999 per year ($288 - $345 per week) 

□ (07) $18,000 - $20,999 per year ($346 - $403 per week) 

□ (08) $21,000 - $23,999 per year ($404 - $461 per week) 

□ (09) $24,000 - $26,999 pe>" year ($462 - $518 per week) 

□ (10) $27,000 - $29,999 per year ($519 - $576 per week) 
D (11) $30,000 and ever per year ($577 or more per weeK) 

2. If you are married and your spouse is employed, what is the approximate 
annual ^^Blary or weekly wage your spouse earns in his or her current 
job? (PLtASE CHECK ONE) 

Q ,(01) Less than $3,000 per year (less than $58 per week) 

□ (02) $3,000 - $5,999 per year ($58 - $114 per week) 

□ (03) $6,000 - $8,999 per year ($115 - $172 per week) 

□ (04) $9,000 - $11,999 per year ($173 - $230 per week) 

□ (05) $12,000 - $14,999 per year ($231 - $287 per week) 

□ (06) $15,000 - $17,999 per year ($288 - $345 per week) 

□ (07) $18,000 - $20,999 per year ($346 - $403 per week) 

□ (08) $21,000 - $23,999 per year ($404 - $461 per week) 

□ (09) $24,000 - $26,999 per year ($462 - $518 per week) 

□ (10) $27,000 - $29,999 per year ($519 - $576 per week) 
Q (11) $30,000 and over per year ($577 or more per week) 

3. What is your current estimated annual income from other sourcer,'--such 
as interest earned from savings accounts and profits from rental pro- 
perties? (Please write in your estimate in the space below.) 

Income from other sources = $ /year 
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STUDENT ASPIRATIONAL OUTCOME MEASURES 



Outcome structure Category lo-^ioo 

10.2750 



H-l 

Measure 
Number 



Measure Nome 



students seeking additional degrees and certificates 



Definition 



Number and percentage of exiting or former students who have been admitted or are 
seeking admission to another educational program which when completed will result 
in a degree or certificate, by type of degree or certificate and by student major 
program 



Data Sources 

Exiting Students, Former Students 



Procedures 

Interviews; administration of a survey questionnaire 



Uses 


Institutional 


State 


Comments 1 



This measure was included in the original field review document and has been pilot tested. 

The procedure for determining this measure has been developed so that outcome measure 
N-7, "Number and percentage of students working toward or receiving another degree or 
certificate after a certain period of time," is obtained at the same time. 
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STUDENT ASPIKATICNAL OUTCOME MEASURES 



- QUESTIONNAIRE ITEMS FOR OUTCOME MEASURE H-1 



I .Since this outcome measure, H-1, and outcome measure N-7 ("Students working 

■ toward and receiving another degree or certificate") are likely to be de- 
sired simultaneously, survey questionnaire items have been developed to 

■ obtain data for both outcome measures at the same time. Since data for the 
two outcome measures can be obtained for either exiting students or former 

I students, two sets of questionnaire items are presented here. 

■ Items for an EXITING-STUUENT Questionnaire 

Item 3b requires the use of a coded list of student m,ajor program. Appendix 
m B presents a list of educational progrdnis that can be used by students to code 

m their major. (The institution may instead wish to use its own list or the one 

used by the American College Testing Program or by the College Entrance Exam- 

■ ination Board, in their college entrance test batteries.) 

■ Items for a FORMER-STUDENT Questionnaire 

Two alternative sets of items have been developed for inclusion in a questionnaire 
I for former students. The first alternative is more detailed and may be more 

appropriate in a former-student questionnaire sent to graduates of the insti- 

■ tution. The second alternative procedure is designed to obtain more general 

■ information about a former student's educational plans and it may be more appro- 
priate for inclusion in a questionnaire sent to former students who have "dropped 

I out." 

g Item 2 in Alternative #1 requires the use of a coded list of student major 

■ programs. Appendix B presents a list of educational programs that students can 
I use to code their major. (The institution may instead wisn to use its own list 

or the one used by the American College Testing Program or by the College En- 
I trance Examination Board, in their college entrance test batteries.) 
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STUDENT ASPIRATIONAL OUTCOME MEASURES 

Items for an EXITING-STUDENT Questionnaire 



!• Have you applied for admission to one or more educational programs 
(either here or at another school) which would result in your earning 
anothe** degree? (Check one) 

I I (1) Yas, I have applied, 

j ] (2) Mo, but I intend to apply within the next six months. 

\ [ (3) iNo, and I do not intend to apply within the next six 
months • 



2. Have you been accepted for any of the programs to which you have 
applied? (Check one) 

(1) The question is not applicable to me because I have not 
applied to any schools. 

PT (2) Yes, I have been accepted. 

a 

Q (3) No, all my applications have been rejected. 

pi (4) No, but I have not yet received a reply on all my 
appl ications. 



3a. What kind of degree or certificate would result from the program(s) 
to which you have applied? (Check one) 

1~| (1) Associate degree 

Q (2) Bachelor's degree 

[~j (3) Master's degree 

PTl (4) Professional degree (Includes only dentistry, medicine, 

optometry, osteopathy, podiatry, veterinary medicine, law, 
and theology) 

□ (5) Doctorate (e.g., Ph.D., Ed.D., D.3.A.) 

|~) (5) Other (please specify) 



3b. From the list that appears on page please select the entry that 
most closely corresponds to the field of study that you plan to pur- 
sue, and write iis4-digit code number in the space below. 

Field of Study [ |_] [J . 
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STUDENT ASPIRATIONAL OUTCOME MEASURES 



Items for a FORMER-STUDENT Questionnaire 
Altern-juivn #1 



Have you applied for admission to one or more educational programs at 
another college or university which would result in your earning 
another degree or certificate? (Check one) 

[ I (1) fio, I have not applied. 

I I (2) Yes,' I have applied and been accepted. 

I I (3) Yes, but I have not been accepted. 

I I (4) Yes, but I have not yet received a reply on all jr^y 
appl ications . 



2a. What kind of degree (s.) or certificate(s) were you (or are you) 
seeking? (Please write in the space below a ]_ if you have sought 
a degree or certificate but have n6t been awarded it, and a £ if 
you have already been awarded it.) 



0(2 
C2(3 

O (1 

a (5 

D(6 

□ (7 

□ (8 



Certificate 

Diploma (Other than those listed below) 
Associate degree 
Bachelor's degree 
Master* s degree 

Professional degree (Includes only dentistry, medicine, 
optometry, osteopathy, podiatry, veterinary medicine, law, 
and theology) 

Doctorate (e.g., Ph.D., Ed.D., D.B.A.) 

Other (please specify) 



2b. From the list that appears on page , please select the entry that 
most closely corresponds to the field of study vou most recently 
pursued (or are pursuing now), and write its4-digit number in the 
space below. 



Field of Study | | | | J 
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STUDENT AbPlRATlONAL OUTCOME MEASURES 



Alternative ^1 continued 



3. Are you interested in taking other courses at our college? You may 

include courses not presently offered by our college. (Check one) 

□ (1) No 

□ (2) Yes; what course(s) . 



Alternative #2 



What are your current educational plans? (Check one) 

i~| (1) Have already re-enrolled at this school 

O (2) Plan to re-enroll at this school witnin six months 

n (3) Have already re-enrolled at another school 

n (4) Plan to re-enroll at another school within six months 

L] (5) Have no plans to attend school within six months 
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STUDENT ASPIRATIONAL OUTCOME MEASURES 



Outcome structure Category 10.2100 



H-2 



Measure 
Number 



Measure Name 



Highest degree or certificate planned 



Definition 



Number and percentage of students and/or former students identifying 
a certain degree or certificate as the highest planned. 



Data Sources 



Current Students, Exiting Students, Former Students 



Procedures 



Interviews; Administration 'A a survey questionnaire 



Uses 



Institutional 



State 



Comments 



ERIC 



This rreasure was included in the original field review document and 
has been pilot tested. 

This measure can be used as an indicator of the educational or competency 
level desired and valued by students (student educational aspirations). 
If collected from students at entrance, in progress, at exit, and after 
they have left the institution (for example, two years later), the 
measure can provide information about changes in the educational 
aspirations of students. 
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STUDENT ASPIRATIONAL OUTCOME MEASURES 



QUESTIONNAIRE ITEMS FOR OUTCOME MEASURE H-2 

Data for outcome measure H-2 can be obtained using a survey quest1onnai»^e 
completed by students currently enrolled in the institution, students as 
they are leaving, and former- students sometime after they have left. It 
should be noted that the questionnaire items developed for obtaining data 
for this measure are comparable to those used in the American Council on 
Education's longitudinal follow-up study of college students. As a result, 
comparisons can be made between the results of the ACE follow-up study 
and the results derived from the use of these items. 

Similar items are included in the college entrance batteries of the American 
College Testing Program and the College Entrance Examination Board. This 
may mean that information already is available for entering freshmen. 
Furthermore, both organizations annually develop various types of norms for 
such variables. 

Procedures for CURRENT-, EXITING-, and/or FORMER-STUDENT Questionnaires 

The following items are appropriate for inclusion in questionnaires designed 
to obtain outcome measure H-2 from CURRENT STUDENTS, EXITING STUDENTS 
(program completers and noncompleters) , and/or FORMER STUDENTS (graduates 
and nongraduates) . Item #2, which asks the respondent to identify 
when he or she plans to complete the highest degree or certificate, should 
be considered optional. 
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STUDENT ASPIRATIONAL OUTCOME MEASURES 
f'-easure H-2: CURRENT-, EXITING-, and/or FORMER-STUDEIJT Questionnaire 



FOUR-YEAR COLLEGE AND/OR UNIVERSITY 

la. Regardless of whether you are going on to another educational program 
at this time, v;hat is the highest degree you eventually intend to 
complete? (Check one) 

[~] (1) Associate degree 

I 1 (2) Bachelor's degree 

(3) Master's degree 
^ (4) Specialist degree (e.g., Ed.S.)- 

_ (5) Professional degree (includes only dentistry, medicine, 

optometry, osteopathy, podiatry, veterinary medicine, law, 
and theology) 

□ (6) Doctor's degree (e.g* Ph.D. , Ed.D., D.&.A.) 
COMMUNITY COLLEGE f 

lb. If you are planning to continue your education, what is your goal? 
(Check one) 

Q (1) I do not plan to complete an additional degree or 
- — , certificate. 
U (2) Certificate 

I I (3) Associate degree 



I I (7) Professional degree (includes only dentistry, medicine, 

optometry, osteopathy, podiatry, veterinary medicine, law, 
and theology) 

□ (8) Doctor's degree (e.g., Ph.D., Ed.D., D.B.A.) 




Bachelor's degree 

Specialist degree (e.g., Ed.S.) 

Master's degree 
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STUDENT ASPI RATIONAL OUTCOME MEASURES 

Measure H-2: CURRENT-, EXITING^, and/or FOR M ER-STUDENT Questionnaire continued 



NOTE: 



When do you expect to attain your planned highest level of education? 

(Please check one.) 

□ (1) I have already attained it. 

□ (2) This' year (1980) 

□ (3) 1981 

□ (4) 1982 

□ (5) 1983 
D (6) 1984 

□ (7) 1985 

□ (8) After 1986 

□ (9) Not sure 



When using this item, 
substitute the number 
of years ahead of the 
base year. 



If it is desirable to know the major field of study that will be associated 
with the highest degree a respondent plans to complete, the following alterna- 
tive item can be inserted in place of the first item presented above. Note: 
this item will need to be accompanied by a coded list of majors. Appendix B 
presents a list of education programs that can be used by students to code 
their major. Some institutions will prefer to use a locally developed list 
of majors tailored for the programs offered at that school and at the level of 
detail needed by various decisionmakers therp, or the lists developed by the 
American College Testing Program or the College Entrance Examination Board for 
their entrance test batteries. If yourinsti tution participates in the ACT 
Program or the SAT Program, use of the ACT or SAT lists of majors would allow 
comparisons of student choices at different points in time. 
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STUDENT ASPIKATIONAL OUTCOME MEASURES 



FOUR-YEAR COLLEGE AND/OR UNIVERSITY 

la. Regardless of v/hether you are going on to another educational program 
at this time, what is the highest degree you eveniually intend to 
complete? (Check one) 

I } (1) Associate degree 

(~| (2) Bachelor's degree 

I I (3) Master's degree 

I I (4) Professional degree (includes only dentistry, medicine, 
optometry, osteopathy, podiatry, veterinary medicine, 
law, and theology) 

□ (5) Doctor's degree (e.g., Ph.D., Ed.D., D.B.A.) 

f 

COMMUNITY COLLEGE 

lb. If you ere planning to continue your education, what is your goal? 
(Check one) 

Q (1) I do not plan to complete an additional degree or 
certificate. 

I [ (2) Associate degree 

j~] (3) Bachelor's degree 

I I (4) Master's degree 

[~{ (5) Professional degree (includes only dentistry, medicine, 

optometry, osteopathy, podiatry, veterinary medicine, law 
and theology) 

□ (6) Doctor's degree (e.g., Ph.D., Ed.D., D.B.A.) 

2. From the list that appears on page , please select the entry that 
most closely corresponds to the fieTJof study for the degree or 
certificate above and write its 4 -digit code number in the space 
below. 

Field of Study: | | | I J 
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STUDENT ASPIRATIONAL OUTCOME MEASURES 



Outcome structure Category 12.2100 



H-3 



Measure 
Number 



Measure Name 



Change and Stability of Career Goals 



Definition 



The number and percentage of former students who have maintained or changed their 
career goals between the time they left the institution and the present time. 



Data Sources 



Former Students 



Procedures 



Interviews; administration of a survey questionnaire. 



Uses 



Institutional 



State 



Comments 



This measure was included in the original field review document, and has been 
pilot tested. 
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STUDENT ASPIRATIONAL OUTCOME MEASUf^ES 



QUESTIONNAIRE ITEMS FOR OUTCOME MEASURE H-3 



One procedure recormended for obtaining data for outcome measure H-3 is the 
use of a survey questionnaire. The questionnaire items presented below 
are intended to cope with the situation in which a user has no prior infor- 
mation about the respondent's occupational career choice at the time the 
respondent left the institution. 

Procedures for a FORMER-STUDENT Questionnaire 



(SEE FOLLOWING PAGE) 



f 
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STUDENT ASPIRATIONAL OUTCOME MEASURES 



1. The following items are intended to help us learn whether you have 
changed your "desired" long-run career employer and long-run career 
occupation since you left [Name of Institution]. 

a. PLEASE CHECK ONE IN EACH COLUMN: 



Desired Desired 

EMPLOYER EMPLOYER 

When You Left At This 

[Name of Institution] Time 



Government: Federal ' • (01 ) • (01) 

State (02) . . (02) 

Local (03) • ^(03) 



Education: Elementary and 

Secondary-. - . (04) . . (04) 



Postseconda ry 

Education. (05) . . ^(05) 



Other Nonprofit 

Organizations: Hospitals, clinics. . . • (06) . . (06) 

Social Welfare <(.... (07) . . (07) 

Church ......... (08) . . (08) 



Other nonprofit 

organizations (09) . . (09) 



Self-employed or Family 

Businecs (10) . . (10) 

Private Company (11) . . {^^) 

Professional Partnership. (12) . . (12) 

Research (13) . . {U) 

(Please specify) (14) . . (14 



b. From the list that appears on page , please write in the 2-digit 

code of the entry that applies to each of the following two questions: 

(1) What was your desired long-run career 

occupation when you left [Name of Institution]? I i i 

(2) What is your desired long-run career 

occupation at this time? I I I 
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STUDENT MORALE, SATISFACTION, AND AFFECTIVE OUTCOME MtASURES 



10.2330 

Outcome structure Category 10.2770 



Measure 
Number 



Measure Name 



student satisfaction with overall educational experience 



Definition 



The responses of students to questionnaire items measuring the degree of 
satisfaction with their overall college education experience 



Data Sources 



Current Students, Exiting Students, Former Students 



Procedures 



Interviews; administration of a survey questionnaire 



Uses 



Institutional 



State 



Comments 



This measure was included in the original field review document, and has been 
pilot tested. 
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STUDENT MORALE, SATISFACTION, AND AFFECTIVE OUTCOME MEASURES 



QUESTIONNAIRE ITEMS FOR OUTCOME MEASURE J-1 



One procedure recommended for obtaining data for outcome measure J-1 
Is the use of a survey questionnaire. The particular set of questions 
suggested is a modification of a series of questions developed by C, Robert 
Pace and his associates in the Higher Education Measurement and Evaluation 
Kit (1975) to determine students' "general satisfaction with college." 

Procedures for CURRENT-, EXITING-, or FORMER-STUDENT Questionnaire 

The following series of questions is appropriate for use in questionnaire 
surveys of an institution's current students, exiting (program completers 
and noncompleters) students, and former students (graduates and nongraduates) . 
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STUDENT MORALE, SATISFACTION, AND AFFECTIVE OUTCOME MEASURES 



1. In general, how well do you like attending college? 

rjiO) I don't like it 

I [ (2) I am more or less neutral about it 

pj(3) I like it 

I 1(4) I am enthusiastic about it 



2. If you could start over again, would you still choose toattend 
(Name of Institution)? 



□ (1) Definitely no 
□(2) 

Probably no 
D (3) Probably yes 
I 1(4) Definitely yes 



3, Regardless of any vocational benefit college may have for you at this 
point in time, do you think that being in college is a very important 
and beneficial experience? 

0) Definitely no Why? 

(2) Generally no 

(3) Generally yes 

{^) Definitely yes 
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STUDENT MORALE, SATISFACTION, AND AFFECTIVE OUTCOME MEASURES 



10.2270 
10.2330 

Outcome Structure Category 1 0.2770 



J-2 



Measure 
Number 



Measure Name 



Student satisfaction with vocational preparation 



Definition 



The responses of students to questions about the degree of satisfaction with 
their vocational preparation 



Data Sources 



Current Students, Exiting Students, Former Students 



Procedures 



Interviews; administration of a survey questionnaire 



Uses 



Institutional 



State 



Comments 



This measure was included in the original field review document, and has been 
pilot tested. 
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STUDENT MORALE, SATISFACTION, AND AFFECTIVE OUTCOME MEASURES 



QUESTIONNAIRE ITEMS FOR OUTCOME MEASURE J-2 

One procedure recommended for assessing student satisfaction with vocational 
preparation is the use of a -survey questionnaire. The questionnaire items 
and format used to derive this measure are a modified version of the 
"Educational Benefits: Vocational Scale," which is included in the 
Higher Education Measurement and Evaluation Kit (1975) developed by C* Robert 
Pace and his associates at the Center for Study of Evaluation, University 
of California, Los Angeles. The scale is intended to measure the extent to 
which students or former students feel their college work and experience 
have benefited them in achieving certain vocational preparation goals. 

Procedures for CURRENT-, EXITING-, or FORMER-STUDENT Questionnaire 

The following scale is appropriate for use in questionnaire surveys of 
current students, exiting students, and former students. 
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STUDENT MORALE, SATISFACTION, AND AFFECTIVE OUTCOME MEASURES 



1. In thinking over your educational experiences at (Name of Institution) j 
to what extent do you think these experiences contributed to your 
progress in each of the following areas? Please check the appropriate 
box to the right of each category. 





(1) 


(2) 


(3) 


(4) 


- 


Very 
Little 


Some 


Quite 
A Bit 


Very 
Much 


A. Background and specialization 
for further education in some 
professional, scientific, or 
scholarly field 


■ 








B. Basis for improved social and 
economic status 










C. Vocabulary, terminology, and 
facts in various fields of 
knowl edge 










D. Skills and techniques directly 
applicable to a job 








1 



2. How v/ell do you feel our college prepared you for vour current job? 
(Check one) 

I I (1) Inadequate preparation 
I I (2) Fair preparation 
I I (3) Good preparation 
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STUDENT MORALE, SATISFACTION, AND AFFECTIVE OUTCOME MEASURES 



11 .2330 

Outcome Structure Category iiiizoo 



J-3 



Measure 
Number 



Measure Name 



student satisfaction with college services 



Definition 



The responses of students to questions about the degree of satisfaction and 
iiat of services offered by this college 



Data Sources 



Exiting Students, Graduating Students, Former Students 



Procedures 



Interviews; administration of a survey questionnaire 



Uses 



Institutional 



State 



Coinments 



Although this measure was not included in the original field review document, it 
was pilot tested. 

The purpose of this measure is to assess student satisfaction with college services. 
The list of services shown in the sample item is illustrative; it is recognized 
that each institution would have its own set of unique services. 
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STUDENT MORALE, SATISFACTION, AND AFFECTIVE OUTCOME MEASURES 



QUESTIONNAIRE ITEMS FOR OUTCOME MEASURE J-3 



One procedure recommended for assessing student satisfaction with college 
services is the use of a survey questionnaire. The following questionnaire 
items were developed by a task force of four-year and coninunity college 
administrators and was pilot tested in six institutions. 
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STUDENT MORALE, SATISFACTION, AND AFFECTIVE OUTCOME MEASURES 



How satisfied were you with each of the college services listed below? 
(If you never used a particular service or the service was not available, 
check only the first or second column.) 

Satisfied 1 

Somewhat Satisfied 

Dissatisfied 

This Service Not Available 

Never Used This Service r 



a. 


Admissions Office Information 


□ 


□ 


□ . 


□ 


- □ 


b. 


Registration 




□ 




□ 


Q 


c. 


Financial Aid Office 


□ [ 


□ 


- □ 


□ 


□ 


d. 


Student Employment Services 
While Attending College 


□ 


□ 


" □ 


□ 


□ 




Job Placement Office After 
College 


t □ 


□ 


□ 


□ 


□ 


f. 


Academic Advising (faculty) 


□ 


□ 


□ 


□ 


□ 


g- 


Academic Advising (counselors) 


□ 


□ 


□ 


□ 


□ 


h. 


Guidance and Counseling Services 


□ 


□ 


□ 


□ 


□ 


i . 


Reading, Writing, Math Skills 
Improvement 


□ 


□ 


□ 


a 


□ 


j. 


Testing Services 


□ 


□ 


□ 


□ 


□ 


k. 


Career Development 


□ 


□ 


□ 


□ 


□ 


1. 


Cafeteria 


□ 


□ 


□ 


□ 


□ 


m. 


Recreation and Athletic Programs 


□ 


□ 


□ 


□ 


□ 


n. 


Library 


□ 


□ 


□ 


□ 


□ 


0. 


Health Center 


□ 


□ 


□ 


□ 


□ 


P- 


Housing Facilities 


□ 


□ 


□ 


□ 


□ 


q 


College Cultural Programs 


□ 


□ 


□ 


□ 


□ 


r. 


Minority Affairs Office 


□ 


□ 


□ 


□ 


□ 
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10.2200 
10.2330 

Outcome Structure Category 10.2770 



J-5 



Measure 
Number 



Measure Name 



student satisfaction with knowledge and skills in the humanities 



Definition 



The responses of students to questionnaire items measuring the degree of 
satisfaction "'ith their knowledge and skills in the humanities, including 
philosophy, literature, the arts, and langi,iage - . 



Data Sources 



Current Students, Exiting Students, Former Students 



Procedures 



Interviews; administration of a survey questionnaire 



Uses 



Institutional 



Comments 



state 



This measure was included in the original field review document, and has been 
pilot tested. 
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STUDENT MORALE, SATISFACTION, AND AFFECTIVE OUTCOME MEASURES 



QUESTIONNAIRE ITEMS FOR OUTCOME MEASURE J-5 

One procedure recommended for assessing student satisfaction with knowledge 
and skills in the humanities area is the use of a survey questionnaire. 
The questionnaire items and format used to derive this measure are a modified 
version of the "Educational Benefits: H^^anistic Scale," which is presented 
in the Higher Education Measurement and Evaluation Kit developed by C. .Robert 
Pace and his associates at the Center for the Study of Evaluation, University 
of California, Los Angeles (1975) • The scale is intended to measure the extent 
to which students or former students feel their college work and experience 
have benefited them in achieving certain goals related to knowledge and skills 
in the humanities. 

Procedures for CURRENT-, EXITING-, or FORMER-STUDENT Questionnaire 

The following scale is appropriate for use in questionnaire surveys of 
current students, exiting students (program completers and noncompleters) , 
and former students (graduates and nongraduates) . 
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STUDENT MORALE, SATISFACTION, AND AFFECTIVE OUTCOME MEASURES 



1. In thinking over your educational experiences at (Name of Institution), 

to what extent do you think these experiences contributed to your t 
progress in each of the following areas? 

Please check (/) the appropriate box to the right of each category. 





(1) (2) (3) (4) 
Very . : Quite - Very 
Little Some A Bit Much 


A. Awareness of different 
philosophies, cultures, 
and wavs of Hfp 










Broadened literary acquain- 
tance and appreciation. 


— * 








C. Aesthetic sensitivity; 
Appreciation and enjoyment 
of art, music, drama. 










D. Writing and speaking: 
clear, correct, 
effective communication. 











-220- 

232 



STUDENT MORALE, SATISFACTION, AND AFFECTIVE OUTCOME MEASURES 



10.2250 

Outcome structure Category to-2330 



J-6 



Measure 
Number 



Measure N'me 



student satisfaction with critical thinking ability 



Definition 



The responses of students to questionnaire items i.ieasuring the degree of 
satisfaction with their ability to formulate and analyze problems 



Data Sources 



Current Students, Exiting Studsnts, Former Students 



Procedures 



Interviews; administration of a survey questionnaire 



Uses 



Institutional 



Comments 



state 



This measure was included in the original field review document, and hu.^ '"ieen 
pilot tested. 
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STUDENT MORALE, SATISFACTION, AND AFFECTIVE OUTCOME MEASURES 



QUESTIONNAIRE ITEMS FOR OUTCOME MEASURE J-G 

One procedure recommended for assessing student satisfaction with critical 
tninking ability is the use of a survey questionnaire. The questionnaire 
items and format used to derive this measure are a modified version of the 
"Educational Benefits: Critical Thinking Scale," which presented in the 
Higher Education Measurement and Evaluation Kit developed by C. Robert Pace 
and his associates at the Center for the Study of Evaluation, University of 
California, Los Angeles (1975). The scale is intended to measure the extent 
to which students or former students feel their college work and experience 
have benefited them in achieving certain goals related to intellectual skills 
and abilities. 

Procedures for CURRENT-, EXITING-, or FORMER-STUDENT Questionnaire 

The following scale is appropriate for use in questionnaire surveys of 
current students, exiting students (program completers and noncompleters) , 
and former students (graduates and nongraduates) . 
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1. In thinking over your educational experiences at (Name of Institution), 
to what extent do you think these experiences contributed to your 
progress in each of the following areas? 

Please check (/) the appropriate box to the right of each category. 



- 


(1) 

Very 
Little 


(2) 
Some' 


(3) 
Qui te 
■ A Bif 


(4) 
Very . 
Much 


A. Reasoning ability: recog- 
nizing assumptions, making 
logical inferences, and 
reaching correct conclu- 
sions. 






- 




B. Ability to see relationships, 
similarities, and differences 
between ideas. 


f 


— 








\j. unaers uana 1 ng tne nature of 
science, experimentation 
and theory. 










D. Critical thinking: ability 
to withhold judgment, raise 
questions, and examine 
contrary views. 










E. Quantitative thinking: 
understanding concepts of 
probability, proportion, 
j margin of error. 
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10.2260 

Outcome Structure Category to -2330 



J-7 



Measure 
Number 



Measure Name 



student satisfaction with human relations skills 



Definition 



The responses of students to questionnaire items niea':uring the degree of 
satisfaction with their progress in achieving human relations skills 



Data Sources 



Current Students, Exiting Students, Former Students 



Procedures 



Interviews; administration of a survey questionnaire 



Uses 



Institutional 



State 



Comments 



This measure was included in the original field review document, and has been 
pilot tested. 
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QUESTIONNAIRE ITEMS FOR OUTCOME MEASURE J-7 

One procedure reconnmended for assessing student satisfaction with human 
relations skills is the use of a survey questionnaire. The questionnaire 
items and format used to derive this measure are a modified version of the 
"Educational Benefits: Human Relations Scale," which is presented in the 
Higher Education Measurement and Evaluation Kit developed by C. Robert Pace 
and his associates at the Center for the Study of Evaluation, University of 
California, Los Angeles (1975). The scale is intended to measure the extent 
to which students or former students feel their college work and experience 
have benefited them in achieving certain human relations skills goals. 

Procedures for CURRENT-, EXITING-, or FORMER-STUDENT Questionnaire 

The following scale is appropriate for use in questionnaire surveys of 
current students, exiting students (program competers and noncompleters) , 
and former students (graduates and nongraduates) . 
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!• In thinking over your educational experiences at (Name of Institution), 
to what extent do you think these experiences contributed to your 
progress in each of the following areas? 

Please check (/) the appropriate box to the right of each category. 





(1) 
Very 
Little 


(2) 
Some 


(3) 
Quite 
A Bit 


(4) 

Very 

Much 


A. Personal development: urder,- 
standing one's abilities and 
limitations, interests, and 
standards of behavior. 




- 






B. Development of friend- 
ships and loyalties of 
lasting value. 










C. Appreciation of individual- 
ity and independence of 
thouaht and artinn 










D. Social development: exper- 
ience and skill in relating 
to other people. 










E. Tolerance and understanding 
of other people and their 
vi ews . 










F. Appreciation of religion: 
moral and ethical standards. 
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12.2330 
12.2770 



Outcome structure Category ^^-^^^^ 



J-8 



Measure 
Number 



Measure Name 



Job satisfaction 



Definition 



The general satisfaction of former students with their job experiences 



Data Sources 



Former students 



Procedures 



Interviews; administration of a survey questionnaire 



Uses 



Institutional 



Comments 



state 



This measure was included in the original field review document, and has been pilot 
tested. 
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QUESTIONNAIRE ITEMS FOR OUTCOME MEASURE J-8 

One procedure recommended for determining job satisfaction is the use of a 
survey questionnaire. Interest in job satisfaction as an outcome measure 
could relate to a former student's satisfaction with his or her first job 
or with his or her current job. As a result, questionnaire items have been 
developed to serve both purposes- Whether both items \^ould be used in 
the same questionnaire would depend on the purpose cf the data collection 
effort. 

Procedures for e FORMER-STUDENT Questionnaire 



(SEE FOLLOWING PAGE) 
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STUDENT MORALE, SATISFACTION, AND AFFECTIVE OUTCOME MEASURES 
Alternative #1 : Satisfaction with first job. 



In general, how well did you (or do you) like your first job after 
leaving (Name of Institution)? 

[](1) I didn't (don't) like it. 

mi (2) I was (am) more or less neutral about it. 

QO) I liked (like) it. 

Q(4l I was (am) enthusiastic about it. 

Which statement best describes how you regard your current full-time job? 
(Check one) 



□ 0 

□ (2 

□ (3 



□ (4 

□ (5 



(6 



3. To what 



enrolled in at our school? (Check one) 



□ (1 

tZ] (2 

□ (3 
4. Please 



(2 

□ (3 

□ (4 



Employment with definite career potential 

Employment with possible career potential 

Employment to earn money while I decide what 
kind of work I want 

Temporary employment to earn money to do something else 
(travel, school, have free time, etc.) 

Temporary employment until I can find a job in my field 

Temporary employment until I can find something better 

extent was this job related to the major/program you were 



Not related 
Somewhat related 
Directly related 
heck from the list below the principal reason why your current 



job is not in your major/program 

(1) I never looked for a job related to my major/program 

I looked, but could not find a job related to my major/program 
without moving out of the geographic area. 

I looked, but could not find a job related to my major/program 
even in other geographic areas. 

I have held a job related to my major/program, but decided to 
get into a new employment field. 



1 ® 
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Alternative #2: Satisfaction with current job. 



1. In general, how well do you like your current job? 
H] (1) I don't like it. 

I I (2) I am more or Tess neutral about it. 

n (3) I like it. 

Q (4) I am enthusiastic about it. 

2. Which statement best describes how you regard your current full-tijre job? 
(Check one) 

I I (1) Employment with definite career potent^'al 
I ! (2) Employment with possible career potential 

I I (3) Employment to earn money while I decide what kind of work I want 

I I (4) Temporary employment to earn money to do something else (travel, 
school, have free time, etc.) 

i I (5) Temporary employment until I can find a job in my field 

f^J (6) Temporary employment until I can find something better 

3. Is your job related to your majqr field of study (your program)? 

Directly related 
□ (2) Somewhat related 
I |(.3) Not related at all 
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Outcome Structure Category 11 .2710 



N-l 



Measure 
Number 



Measure Name 



Program completers during a certain time period 



Definition 



The number and percentage of students completing a degree or certificate 
during a certain period of time; by student program 



Data Sources 



Institutional Student Records 



Procedures 



Search of Institutional Records 



Uses 



Institutional 



State 



Comments 



This measure was included in the original field review documents, and has been 
pilot tested. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE N-1 

The procedure recommended for obtaining data for outcome measure N-1 is 
straight forward and requires the use of institutional records. 

Procedure for Use of Institutional Records 

1. ^ For a specific period of time (such.as a fiscal year), identify: 

(1) all students who have received a degree or certificate, and 

(2) all students who were. eligible to receive a degree or cer- 
tificate but did not complet^ the necessary administrative steps 
to actually receive the award. Many institutions may not have 
any degree or certificate completers of this second type or may 
not be able to identify those they do have. 

2. For each completer, identify the type of degree or certificate 
he or she received (or was eligible to receive): 

Certificate 

Diploma (Other than those listed below) 
Associate degree 
Bachelor's degree 
Master's degree 

Professional degree (Includes only dentistry, medicine, 
optometry, osteopathy, podiatry, veterinary medicine, 
law, and theology) 

Doctorate (e.g., Ph.D., Ed.D., D.B.A.) 

Other (Please specify) 

Undecided 

3. Ne^'t, identify the student program (bachelor's degree in genetics, 
a certificate in welding, and so forth) associated with the degree 
or certificate received by each program completer. The appropri- 
ate student category for each student should be determined 
according to his or her major at the time of graduation. You can 
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use one of the lists of occupations and educational programs 
presented in Appendix B or the Higher Education General Infor- 
mation Survey (HEGIS) discipline list in Appendix C to code the 
student programs identified. Although the HEGIS list designates 
disciplines, for purposes of this procedure the list can be used 
to designate student programs when appropriate. 

4. Finally, identify each program completer's status when he or she 
entered the institution: 

a. New Undergraduate Student 

b. Transfer Undergraduate Student 

c. New Graduate Student 

d. Transfer Graduate Student 

5. For a descriptive summary of the data, calculate the number and 
percentage of students completing a degree or certificate during 
the designated period of time, by type of student program and by 
student status at entrance. 
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Outcome Structure Category n-^^ic 



N-2 



Measure 
Number 



Measure Name 



Program completers who entered as transfer students 



Definition 



Number and parcentage of students who entered as transfer students earning a 
degree or certificate during a certain period of time by status at entrance 



Data Sources 



Institutional Student Records; Students 



Procedures 



Search of Institutional Records; Interviews; Administration of a survey 
questionnaire 



Uses 



Institutional 



State 



Comments 



This measure was included in the original field review documents, and has 
been pilot tested 
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ACQUISITIO:i PROCEDURES FOR OUTCOME MEASURE N-2 

The procedure developed for obtaining data for outcome measure N-1 should be 
used to obtain the data for this outcome measure, N-2. If a question is 
desired to identify transfer students, the following question should be used. 



Did you transfer credits from another college "or university 
toward this certificate or degree? (Check one) 

□ (1) Yes 

□ (2) No 



-235- 



ERIC 



247 



STUDENT STATUS, RECOGNITION, AND CERTIFICATION OUTCOME MEASURES 



Outcome structure Category n>27io 



N-3 



Measure 
Number 



Measure Name 



Degrees and certificates earned by an entering class of students 



Definition 



Number and percen+'age of students In a designated entering cla'-s who have earned a 
degree or ce^rtificate from the institution within a certain period of time, by typo 
of degree or certificate, student status at entrance-, and student program (field 
of study) 



Dota Sources 



Institutional Records of a designated Entering Class of Students (e.g., the 
entering class of 1970) 



Procedures 



Search of Institutional Records 



Uses 



Institutional 



State 



Comments 



This measure was included in the original field review document, and has been pilot 
tested. 

Med'-ures N-3 and N-1 differ in that N-3 identifies the success an entering class 
has had in completing their degree or certificate programs whereas N-1 identifies 
those students earning a degree or certificate during a given period of time with 
no consideration of when they entered the institution. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE N-3 



The procedures developed for acquiring data for outcome measure N-3 are 
based on the use of institutional records. It should be noted that in 
addition to being appropriate for identifying the number and percentage of 
students in an entering class who have graduated or are expected to graduate 
in a certain period of time, the procedures also identify those students in 
an entering- class (1) who are currently enrolled in the institution and 
(2) who have left the institution without receiving a' degree or certificate. 

Procedure for Use of Institutional Records 



1. Select the entering class to be studied. Categorize students 
^ in the entering class in terms of their student status at entrance: 

a. New Undergraduate Students 
m b. Transfer Undergraduate Students 

■ c. New Graduate Students 

d. Transfer Graduate Students 
I 2. Determine the cut-off date to be used in obtaining data for 

outcome measure B-5. 

I 3. Examine student records for the selected entering class and 

m identify: 

a. Those students who have earned a degree or certificate 
I by cut-off date. Students who are eligible to receive 

a degree or certificate but who have not completed the 
I necessary administrative steps to actually receive the 

■ award should be included. 
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Those students who are currently enrolled in the institution- 
c. Those students who left the institution prior to completion of 
a degree or certificate. (This group of students would include 
those who have, left permanently and those who may return.) 
Identify the type of degree or certificate earne<J by each program 
completer: 

Certificate ' • . * 

Diploma (Other than those listed below) 
' Associate degree 
Bachelor's degree 
Master's degree 

Professional degree (Includes only dentistry, medicine, 
optometry, osteopathy, podiatry, veterinary medicine, 
law, and theology) 

Doctorate (e.g., Ph.D., Ed.D., D.B.A.) 

Other (Please specify) K 

Undecided 

Next identify the student major program (bachelor's degree in genotics, 
a certificate in welding, and so forth) for each completer. The 
appropriate student major program category for each student should 
be determined according to his or her major at the time of graduation. 
You can use one of the lists of occupations and educational programs 
presented in Appendix B or the Higher Education General Information 
Survey (HE6IS) discipline list in Appendix C to code the student 
programs identified. Although the HEGIS list designates disciplines, 
for purposes of this procedure the list can be used to designate 
student programs when appropriate. 

For a descriptive summary of the data, calculate the number and 
percentage of students in the selected entering class who have earned 
a degree or certificate within the designated period of time, by 
their status at entrance and their major at graduation. 
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Outcome structure Category n.27io 



N-4 



Measure 
Number 



Measure Name 



Time to program cnmpletion for a graduating class 



Definition 



Amount of time it takes a student in a particular graduating class to earn a 
degree or certificate, by degree or certificate type, student major program, 
and a student status at entrance 



Data Sources 



Institutional Student Records 



Procedures 



Search of Institutional Records 



Uses 



Institutional 



state 



Comments 



This measure was included in the original field review document, and has been 
pilot tested 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE N-4 

The procedure recommended for obtaining data for outcome measure N-4, "Amount 
of time it takes a student in a particular graduating class to earn a degree 
or certificate," requires the use of student institutional records. It is 
important to note. that this procedure does not distinguish graduates who 
have been enrolled on a continuous basis, from those who have been enrolled 
on an intermittent basis. Also, the procedure does not delineate graduates 
who have always been full-time students from those who, at one time or another, 
have been part-time enrollees. If these distinctions ^re important, the 
following steps will need to be modified accordingly. 

f 

Proced ur e for Use of Institutional Records 

1. Select the graduating class to be studied. 

2. Examine institutional records for students in the graduating class 
and identify student status at entrance for each student: 

a. New Undergraduate Student 

b. Transfer Undergraduate Student 

c. New Graduate Student 

d. Transfer Graduate Student 

3. Identify for each student the total number of months elapsed from 
entry date to graduation date and/or the total number of terms 
enrolled (summer terms and soecial sessions inlcuded) from entry 
date to graduation date. 
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4. Determine for each student in the study: 

a. Type of degree or certificate earned: 
Certificate 

Diploma (Other than those listed below) 
Associate degree 
Bachelor's degree 
Master's degree 

Professional degree (Includes only dentistry, medicine, 
optometry, osteopathy, podiatry, veterinary medicine, - 
law,* and theology) 

Doctorate (e.g., Ph.D., Ed.D., D.B.A.) 

Other (Please specify)^ 

•Undecided 

b. Major program at graduation: . ' 

Appendix B presents alternative lists of occupations and 
educational programs that can be used to code each 
graduating student's major program. 

5. Data now are available to calculate the median or mean number of 
months elapsed and/or the median or mean number of terms enrolled by: 

a. Type of degree or certificate earned 

b. Student major program at graduation 

c. Student status at entrance 
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Outcome Structure Category 11 ,2710 



N-5 



Measure 
Number 



Measure Name 



Time to program completion for an entering class 



Definition 



Amount of time it takes a student in a particular entering class to earn a degree 
or certificate, by degree or certificate type, student major program, and 
student status at entrance 



Data Sources 



Institutional Student Records 



Procedures 



Search of Institutional Records 



Uses 



Institutional 



State 



Comments 



This measure was included in the original field review document, and has been 
pilot tested. 

The procedures suggested for obtaining data for this measure allow as the basic 
unit of measurement either total number of months elapsed from entry date to 
graduation or total number of academic terms enrolled in that period of time. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE N-5 

The procedure developed for obtaining data for outcome measure N-5, " Amount 
of time it takes a student in a particular entering class to earn a degree 
or certificate,"' involves the use of student institutional records. It is 
important to note that this procedure does not distinguish graduates who have 
been enrolled on a continuous basis from- those who' have been enrolled on an 
intermittent basis. Also, the procedure does .not delineate graduates who 
have always been full-time studeats from those who, at one time or another, 
have been part-time enrolleef, If these distinctions .are important, the 
following steps will need to be modified accordingly. 

f 

Procedure for Use of Insitutitutional Records 

1. Select entering class to be studied (for example, all new 
undergraduate students who entered Fall term of 1970). 

2. Examine institutional records for the students in the 
designated entering class: 

a. Identify those students who have graduated or are 
expected to graduate by the specified cut-off date 
(such as Spring 1975). 

b. Identify for piach fcudent identified in step a: 

(1) total !;umber of months elapsed from entry date to 
graduation date, and/or 

(2) total jmber of terms enrolled (summer terms and special 
sessions included) from entry date to graduation date. 



-243- 

255 



STUDENT STATUS, RECOGNITION, AND CERTII- ICATION OUTCGMII MEASURES 



Determine for each student in the study: 

(1) Student status at entrance: 
New Undergraduate Student 
Transfer Undergraduate Student 
New Graduate Student 
Transfer Graduate Student 

(2) Type of degree or certificate earned: 
Certificate 

Diploma (Other than those listed below) 
Associate degree 
Bachelor's degree 

Master's degree . - 

Professional degree (Includes only dentistry, medicine, 

optometry, osteopathy, podiatry, veterinary medicine, 

law, and theology) I 
Doctorate (e.g., Ph.D., Ed.D., D.B.A.) 

Other (Please specify) 

Undecided 

(3) Major program at graduation: 

Appendix B presents alternative lists of occupations and 
educational programs Lhat can be used code each student's 
major program at time of graduation. 
Data now are available to calculate the median or mean number of 
months elapsed and/or the median or mean number of terms enrc"'led 
for each graduating student in the designated entering class by: 

a. Student status at entrance 

b. Type of dsgree or certificate earned 

c. Student major program at graduation 
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Outcome Structure Category 



n.27io 

n.2770 



N-6 



Measure 
Number 



Measure Name 



Lducational program dropouts 



Definition 



The number and percentage of full-time students in degree or certificate programs 
who left the institution prior to completion of their program, by stuctent level 
and exit status 



Data Sources 



Former full-time students who were seeking a degree or certificate but 
"dropped out" of the institution 



Procedures 



Search of Institutional Records 



Uses 



Institutional 



State 



Comments 



Tnis measure was included in the original field review document, and has been pilot tested. 

The procedures that tollow are not applicable to students enrolled in certificate programs 
that are conducted for periods of time not synonymous with regular academic sessions (e.g., 
a special five-week certificate program). 

The information obtained for this measure should be reviewed along with information about 
the number of continuing and readmitted students. In combination, these measures can provide 
_ general information about the pattern of student attendance at the institution over a short 
i^QT^'iod of time. 
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Comments N-6 continued. 



The procedure for this measure can be used to identify the group of former students 
who should be surveyed regarding their reasons for leaving the institution before 
completing their program. 

NCHEMS Information Exchange Procedures Outcomes Study Procedures (Technical Report 
No. 66) contains a slightly modified version of the data acquisition procedures 
recommended for this- outcome measure. 
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ACQUISITION PROCEDURES FOR OUTCOME MEASURE N-6 

The procedure recommended for obtaining data for outcome measure N-6 
requires the use of institutional records. An advantage of the proce- 
dure is that it establishes a defined period of time that determines 
when a student should be classified as a dropout.* 

Procedure for Use of Institutional Records 

1. Identify all students in degree and certificate programs 

who were enrolled full-time at the institution at one of 

f 

the following point(s) in time prior to the current Fall term: 

a. The previous semester if the institution is on a 
semester system with no summer session (for example, 
the previous semester); 

b. For at least one of the previous two terms if the 
institution is on a semester system in which a summer 
session is a regular term (for example, the previous 
Cummer semester or Spring semester); if the summer 
session is divided into a number or parts, attendance 
during one part constitute^ enrollment for the term; 

c. The previous semester if the institution is on a 4-1-4 
system; 

d. For at least one of the previous two terms if the insti- 
tution is on a trimester system; 



*This time period can be varied depenuing upon the interests of the 
user of th-'s procedure. 
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e. The previous quarter if the institution is on a quarter 
system with three quarters and no surnmer sessions (for 
example, the previous Spring quarter); 

f. For at least one of the two previous terms if the institution 
is on a quarter system with four quarters or three quarters 
and a sunnier session where the summer session is considered 

a regular term (for example, the previous. Summer.* or Spring 
quarter); if the summer is divided into a number of parts, 
attendance during one .part constitutes enrollment for the term. 

2. For each student identified above, identify those who did not 

complete a program prior to the current Fall term. 

I 

3. For the program noncompl eters identified in step 2, determine those 
who are not enrolled at the institution in the current Fall term. 
Determination of enrollment should be made as of the census date 
for the Fall term at the institution. 

4. hor each of the students identified in step 3, determine his or her 
status at the institution as of the end of the last term he or she 
was enrolled: 

a. In Good Standing 

b. Not in Good Standing 

(1) Academically Dropped or Suspended 

(2) Other 

5. For each of the students identified in step 3, determine his or her 
student level as of the end of the last term he o\ she was enrolled: 

a. Lower Division 

b. Upper Division 

c. Graduate 

260 
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6. Data should now be available to calculate the number and percentage 
of full-tini<i students in degree or certificate programs who left 
the institution during the designated time period prior to completion 
of their program, by student level and status at termination. 
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10.2100 

Outcome structure Category 10.2710 



N-7 



Measure 
Number 



Measure Name 



student working toward and receiving another degree or certificate 



Definition 



dumber and percentage of exiting or former students who are working toward or have 
tccGived another degree or certificate, by degree/diploma/certificate type and by 
student major program 



Data Sources 



Exiting Students, Former Students 



Procedures 



Interviews; administration of a survey questionnaire 



Uses 



Institutional 



Comments 



o CO >.e 



This measure was included in the original field review document, and has been 
pilot tested 
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QUESTIONNAIRE ITEMS FOR OUTCOME MEASURE N-7 



The questionnaire items developed for obtaining data for outcome measure H- 
should also be used to obtain the data necessary to derive this outcome 
measure, N-7. 
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10.2720 

Outcome Structure Category 25.2730 



N-8 



Measure 
Number 



Measure Name 



student ability to transfer credits 



Definition 



Number and percentage of exiting and/or former students who hav/e successfully 
transferred credits* to another school 



Data Sources 



Exiting Students, Former Students 



Procedures 



Interviews; administration of a survey Questionnaire 



Uses 



Institutional 



State 



1_ I This measure was included in the original field review document, and it has been 

pilot tested. It and outcome measure N-9 may be useful as indicators of the difficulty and/I 
success of former students who have enrolled in another institution. 

If the procedures for this measure are used in an EXITING-STUDENT Questionnaire, it would | 
be appropriate to include them in the section of the questionniire that contains the exiting 
students' responses concerning whether they have been admitted or are seeking admission to | 
another progrc . (See outcome measures H-1 and N-7.) 
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STUDENT STATUS, RECOGNITION, AND CERTIFICATION OUTCOME MEASURES 

QULSTIONNAIRE ITEMS FOR OUTCOME MEASl N-8 



One of the procedures for identifying student success in transferring credits to 
another institution is the use of a survey questionnaire. Two alternative sets 
of items are presented. For the Alternative #1 set, the first item identifies 
whether the respondent attempted to cransfer any credits. The second question 
identifies reasons why respondents were not successful in transferring credits. 
The second set of items does not speak to credits transfer only; it speaks to 
any problems in transferring. 

Concerning both item sets, it should be noted that this sequence of questions 
usually would be asked after it was deteriyined that the respondent had been admitted 
to or was attending another school. Also, it is assumed that the school to which 
the respondent has transferred will be identified by the respondent in the 
questionnaire. 
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STUDENT STATUS, RECOGNITION, AND CERTIFICATION OUTCOME MtASURES 



Alternative #1 



1. Did you try to transfer credits from [Name of Institution] when you 
were admitted to your new program? (PLEASE CHECK ONE) 

Qd) Yes, and they were all accepted. (SKIP TO QUESTION ) 

I |(2) Yes, but some credits were not accepted. (GO TO QUESTION 2) 

I [ (3) Yes, but none o* the credits were accepted. (GO TO QUESTION 2) 

I [(4) No. (SKIP TO QUESTION ) 

2. What was the major reason that the credits were not accepted? 
(PLEASE CHECK"6neT 

I 1(1) Don't know 

[ j (2) No comparable coi'V*sp 

I I (3) Switched fields of study ^ 

j I (4) Limit on transfer of credits 

I I (5) The institution does not accept transfer credits 

I I (6) Other (Please explain) 



Alternative #2 



Did you have any difficulty in transferring when you enrolled for this 
new college/university program? (Check one) 

I I (1) No, I did not experience difficulty in transferring. 

Q (2) Yes, I experienced difficulty in transferring. Please 
briefly indicate the nature of the difficulty. 
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STUDENT STATUS, RECOGNITION, AND CERTIFICATION OUTCOME MEASU.lES 

12.2720 
12.2770 

Outcome structure Category 25.2730 



N-9 



Measure 
Number 



Measure Name 



Level of achievement of former students in another institution 



Definition 



Number and percentage of former students achieving a certain gradepoint- 
average in another institution 



Data Sources 



Former Students 



Procedures 



Administration of a Survey Questionnaire; reports from other institutions 



Uses 



Institutional 



Comments 



state 



Tin's measure was included in the original field review document, and it has 



been pilot tested. 



This measure and outcome measure N-8 could be useful also as indicators of the success 
of former students who have enrolled in another institution. 
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STUDENT STATUS, RECOGNITION, AND CERTIFICATION OUTCOME MEASURES 



QUESTIONNAIRE ITEMS FOR OUTCOME MEASURE N-9 



The success former students have in achieving an acceptable gradepoint 
average at another school is often determined from grade reports sent by the 
schools in which the fcrmer students enroll. However, in many instances such 
reports are not available. As a result, the following questionnaire items 
have been developed to obtain data for outcome measure N-9 using a survey, 
questionnaire for former students (graduates and nongraduates) . 

Procedures for a FORMER-STUDENT Questionnaire 

(SEE FOLLOWING PAGE) 
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STUDENT STATUS, RECOGNITION, AND CERTIFICATION OUTCOME MEASURES' 



Outcome structure Category n.2770 



N-IO 



Measure 
Number 



Measure Name 



student status at withdrawal time 



Definition 



Characteristics of students that have withdrawn from the institution before 
completing a program 



Data Sources 



Exiting Students, Former Students 



Procedures 



Interviews; administration of a survey questionnaire; search of institutional records 



Uses 



Institutional 



State 



Comments 



Although this measure was not in the original field review document, it has been pilot 
tested. 

The purpose of this measure is to describe relevant academic status characteristics 
of students who withdraw from the institution prior to completion of a program. 
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STUDENT STATUS, RECOGNITION, AND CERTIFICATION OUTCOME MEASURES 



1. How many college credits have you earned since you left [Name of 
Institution]? 

a. Undergraduate Credits 



(2) 
(3) 
(4) 
(5) 
(6) 
(7) 



None 

Less than 10 sem. hrs. (15 qtr. hrs, 
10-19 sem. hrs. (15-29 qtr. hrs.) 

(30-44 qtr. hrs.) 
(45-59 qtr. hrs.) 



20-29 sem. 
30-39 sem. 
40-49 sem. 
50 sem 



hrs. 
hrs. 
hrs. 



(60-74 qtr. hrs.) 



hrs. or more (75 qtr. hrs. or more) 



b. Graduate Credits 



(1) 
(2) 
(3) 
(4) 

3(6) 
(7) 



None 

Less than 10 sem. hrs. (15 qtr. hrs.) 

10-19 sem. hrs. (15-29 qtr. hrs.) 

20-29 sem. hrs. (30-44 qtr. hrs.) 

30-39 sem. hrs. (45-59 qtr. h^'s.) 

40-49 sem. hrs. (60-74 qtr. hrs.) 

50 sem. hrs. or more (75 qtr. hrs. or more) 



2. 



What grade point average have you attained while earning these credits? 
(A 4.00 G.P.A. is equivalent to a straight "A" average.) 



a. Undergraduate G.P.A. 



(1 ) Less than 1 .00 

(2) 1.00 - 1.49 

(3) 1.50 - 1.99 

(4) 2.00 - 2.49 

(5) 2.50 - 2.99 

(6) 3.00 - 3.49 

(7) 3.50 - 3.99 

(8) 4.00 

(9) Not applicable 



b. Graduate G.P.A. 



(1) 
(2) 
(3) 
(4) 
(5) 
(6) 
(7) 
(8) 
(9) 



Less 
1.00 



50 
00 
50 
00 
50 



than 1.00 

- 1.49 

- 1.99 

- 2.49 

- 2.99 

- 3.49 

- 3.99 



4.00 

Not applicable 
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STUDENT STATUS, RECOGNITION, AND CERTIFICATION OUTCOME MEASUkES 



ACQUISITION PROCEDURES FOR OUTCOME MEASURE N-10 

The procedure recommended for obtaining data for outcome measure N-10 is to 
search institutional records to obtain the data. The following questionnaire 
items are provided for colleges that are not able to obtain the information 
from their existing records. 



What was your cumulative grade point average at the time 
you left this school? (Check one) 

□ (1) 1.0 or less 

□ (2) 1.1 to 2.0 

□ (3) 2.1 to 3.0 

□ (4) 3.1 to 4.0 



2. Were you ever on academic probation while enrolled? 
(Check one) 

□ (1) Yes 

□ (2) No 



3. How long were you enrolled before you left this school? 
(Check one) 

I I (1) Less than one term 

I I (2) One term, but le^s than one year 

I I (3) One year or more, but less than tv/o years 

I I (^) Two years or more, but less than three years 

I I (5) Three years or more 
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fTUDENT STATUS, RECOGNITION, AND CERTIFICATION OUTCOME MEASURES 



4. Were you primarily a fun-time (12 hours or more) or part- 
time student while you attended this school? (Check one) 

[~) (1) Primarily full -time 

fn (2) Primarily part-time 

5. During your last two terms at this school, were you 
employed in a job for which you received wages? (Check 
qne) 

□ (1) Not employed at all r 

[~1 (2) Employed 1-10 hours/week 

n (3) Employed 11-20 hours/week 

rn (4) Employed 21-35 hours/week 

I 1 (5) Employed 36 hours or more/week 

6. Check all the sources of support you used to finance your 
last two terms of school. 



□ 


(1) 


Full- or part-time work while at^^ ding school 


□ 


(2) 


Savings 


□ 


(3) 


Supp^^t from parents 


□ 


(4) 


Employer support 


□ 


(5) 


Aid from spouse 


□ 


(6) 


Grants (Basic Opportunity Grant, Supplemental 
Educational Opportunity Grant, and others) 


□ 


(7) 


Leans 


□ 


(8) 


Scholarship 


□ 


(9) 


GI Benefits, Social Security, and othf*r benefits 
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STUDENT STATUS, RECOGNITION,. AND CERTIFICATION OUTCOME MEASURES 

11.2400 

Outcome structure Category ii-2700 



N-ll 



Measure 
Number 



Measure Name 



Reasons for students withdrawing from the institution before completing a 
program 



Definition 



The responses of students to questions about their reasons for leaving the institution 



Data Sources 



Exiting Students, Former Students 



Procedures 



Interviews; administration of a survey questionnaire 



Uses 



Institutional 



state 



Comments 



Although this measure was not in the original field review document, it has been pilot 
tested. 

The purpose of this measure is to collect in a systematic way information in the 
academic, financial, employment, and personal areas about why students are withdrawing 
or have withdrawn from the institution. 



r ^ 
Ieric 
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STUDENT STATUS, RECOGNITION, AND CERTIFICATION OUTCOME MEASURES 



ACQUISITION PROCEDURES FOR OUTCOME MFA^URE N-11 



The procedure recommended for assessing students' reasons for leaving the 
institution before completing a program calls for the use of an exit interview 
or a survey questionnaire. The particular questions presented here were 
developed and pilot tested for the NCHEMS Student Attrition Study. They were 
revised in light of the results of that pilot test and an evaluation by two- 
year colleges and four-year colleges task force representatives. 
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STUDENT STATUS, RECOGNITION, AND CERTIFICATION OUTCOME MEASURES 



Not enough money to go to college 

Applied, but could not obtain financial aid 

Financial aid was not sufficient 

Child care too costly 

This college was too expensive 



rersonal Circumstances 

s. Found stviy too time-consuming 

t. Home responsibilities were too great 

u. Illness, per-^onal or family 

V. Personal problems 

w. Fulfilled my personal educational goals 

X. Marital ;>ituation changed my educational 
plans 

y. Moved out of the area 
z. Child care not available 



1. Listed below are some academic, employment, financial, and personal 
reasons v/hy a student miqht leave college. To what extent are these 
your reasons for leaving this college? (Chec'; one answer for each 
reason, ) 

Major Reaso'^ 
Moderate Reason 
Academic Not a Reason j 

a. Needed a temporary break from studies 

b. Major or courses not available at this 
college 

c- Dissatisfaction with major department 

d. Unsure about my choice of major 

e. Course v/ork not challenging 

f. Low grades - 

g. Found courses too difficult 

h. Inadequate study techniques or habits 

i. Dissatisfied with quality of teaching 
Employment 

j. Scheduling conflict between job and studies 
k. . Accepted a job 
1. Went into military service 
m. Couldn't find a job while in college 
Finaricial 
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□ 
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□ 


□ 


□ 


□ 


□ 


D 


□ 


□ 


□ 


□ 




□ 


□ 


□ 


□ 


□ 


□ 


□ 




□ 
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STUDENT STAfUS, RECOGNITION, AND CERTIFICATION OUTCOME MEASURES 



2. Looking at the list in question 1, please select the three 
most important reasons why you did not return to our college 
this term. (List, in order of importance, the appropriate 
letter [a, b, c, etc,] in the boxes below.) 

First □ Second □ Third □ 



3. If you left our college because of dissatisfaction with some 
aspect of it, please write in the space below what v/e could, 
have done to encourage vou to stay in college. 



4. Please write in the space below the one thing which, if 

changed for the better, would have encouraged you to stay at 
this school . 
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STUDENT STATUS, RECOGNITION. AND CERTIFICATION OUTCOME MEASURES 



12.2750 

Outcome Structure Category i 2.2840 



N--17 

Wasut e 
Number 



Measure Name 



Employment in major field of study 



Definition 



Number and percentage of exiting or former students who are employed in a 
job related to their program of study 



Data Sources 



Exiting Students, Former Students 



Procedures 



Interviews; administration of a survey questionnaire 



Uf.es 



Institutional 



Stne 



Comment s~| " 



This measure was included in the original field review document, and has been pilot 
tested. 
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QUESTIONNAIRE ITEMS FOR OUTCOME MEASURE N-17 



On? procedure for obtaining data for outcome measure N-17 is the use of a survey 
questionnaire. The questionnaire items used to obtain the necessary data should 
be included in the section of an EXITING-STUDENT or FORMER-STUDENT Questionnaire 
that relates to occupational career information. 

Procedure for an EXITING-STUDENT or FORMER-STUDENT Questionnai re 

The following set of items assumes that a respondent has indicated he or she 
has a job. 
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STUDENT STATUS, RECOGNITION, AND CERTIFICATION OUTCOME MbASURES 
Alternative #1 



1. To what extent is your current job related to the major/program you 
were enrolled in at our college? (Check one) 

I i Current job is not related to my major/program 

i I (2) Current job is somewhat related to my major/prograir; 

I i (3) Current job is specifically what I was trained for in my' 
niajor/program 

2. How well do you feel our college prepared you for your current, job? • 
(Check one) - - • 

I I (1) Inadequate preparation 

I I (2) Fair preparation : 

I I (3) Good preparation ^ 

3. If you answered "1" for Item 1, did ycu ever look for a job related to 
your major/program? (Check one) 

□ (1) Yes 
IZl (2) No 

4. If you answered for Item 1, are you willing to move to another 
community to get a job in the field for which you were trained? (Check one) 

iZ] (1) Yes 

□ (2) No 

5. If you answered "1" for Item 1, please check from the list below the ^ 
principal reason why your current job is not in your major/program. 

I I (1) I never looked for a job related to my major/program 

I I (2) I looked, but cojld not find a job related to my major/program 
without moving out of tha geographic area- 

I I (3) I looked, but could not find a job related to my major/program 
even in other geographic areas. 

I I (4) I have hpld a job related to my major/program, but decided 
to get ^i.to a new employment field. 

□ (5) Other (Please specify) 
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Alternative #2 STUDENT STATUS, RECOGNITION, AND CERTIFICATION OUTCOME MEASURES 



1. Is your job related to your major field 

□ (1) Directly related 
I I (c) Somewhat related 

□ (3) Not related at .all 



of study (your major program)? 



2. How well do you feel your studies at [Name of Institution] prepared 
you for this job? 

□ (1) Inadequate preparation 

1 I (2) Fair preparation 

I "] (3/ Good preparation 



3. If you are employed outside your major field of study at [Name of 
Institution], why? (C ECK ALL THAT APPLY) 



□ (1 

□ (2 

□ (4 

□ (5 
0(6 

□ (7 

□ (8 



Never really planned to work in my major field 

Tried but could not find a job in my major field 

Did not feel I learned rnough in rny major field 

Decided I did not like the work in niy major field 

Too little opportunity for advancement in my major f^' jld 

Developed new career interest 

Better job opportunity came along 

Other (Please specify) 
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iTUDENT SmUS, RECOGNITION, AND CERTIFICATION OUTCOME MtASURES 



10.2740 

Outcome structure Category 25.2730 



N-22 



Measure 
Number 



Measure Name 



student success in passing certification and licensing examinations 



Definition 



Name and percentage of students and/or former students passing certification, 
licensing, or qualification examinations (e.g.. Bar Excim, CPA Exam. LPN Exam) 



Data Sources 



E/itinq Students, Former Students 



Procedures 



Interviews; administration of a survey questionnaire 



Uses 



Institutional 



State 



Comments 



This measure was included in the c iginal field review document, and has been pilot 
tested. 

Although the administration of a survey questionnaire is the acquisition procedure 
suggested for obtaining data for outcome measure N-22, it is recogn^-'zed that the 
data necessary for this measure often can be obtained from the agencies or 
organizations that administer the exams. 



r <^ 
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STUDENT STATUS, RECOGNITION, AND CERTIFICATION OUTCOME MtASURES 
QUESTIONNAIRE TEMS FOR OUTCOME MEASURE N-22 

One procedure recommended for determining student success in passing certi- 
fication and licensing examinations involves the development and use of a I 
survey questionnaire. Because data for this measure can be obtained from 
students as they leave the institution and from former students sometime | 
after they have left, one set of questionnaire items has been developed ^ 
for inclusion in an EXITING-STUDENT Questionnaire and another set for inclu- ■ 
sion in a FORMER-STUDENT Questionnaire. I 

Procedures for ai ITING-STUDENT Questionnaire | 

The following item, which was developed' for inclusion in an EX ITING-STUDENT I 
Questionnaire to obtain data for outcome measure H-Z2^ can be used in 
questionnaires designed to surve y program completers as well as program | 
noncompleters . It should be noted, however, that this .tern could be used a 
also to survey students not in degree, diploma, certificate programs; that is, 
nonmatriculating students. If such information would be helpful, a question I 
could be added that asks them to identify the exam(s), if they checked 2, 3, 3r 4. 

Have you taken any licensing or certification examinations (for 

example: real estate exam, nursing exam, or bar exam) since I 

graduating from our school? (Check on( ) I 

I I (1) NO, and 1 do not plan to take any I 
i \ (2) No, I have not taken any exams, but plan to do so 
! I (3) Yes, I have taken an exam and passed | 
I I (4) Yes, I have taken an exam, but I did not pass 

I I v5) Yes, I have taken an exam, but I do not know the results I 
yet 
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STUDENT STATUS, RECOGNITION, AND CERTIFICATION OUTCOME MEASURES 
Procedues for a FORMER-STUDENT Questionnaire 

The following questionnaire item is intended for use in obtaining outcome 
measure N-22 from former students regardless of whether or not they completed 
their program. If such information would be helpful, a question could be 
added that asks them to identify the exam(s), if they checked 2, 3, or' 4. 



Have you taken an^ employment licensing. or certification exam- 
ination since leaving our college? (Check one) 

I r 

[ [ (1) No, and I do not plan to take any 

I (2) No, I have not taken any exams 

! (3) Yes, I have taken an exam and passed 

I (4) Yes, I have taken an exam, but I did not pass 

! I (5) Yes, I have taken an exam, but I do not know the 
results yets 
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STUDENT SOCIAL ACTIVITY- AND ROLE OUTCOME MEASURES 



lu.2100 

Outcome Structure Category io-2840 



0-1 



Measure 
Number 



Measure Name 



Occu-^ation Career Choice 



Definition 



Number and percentage of students choosing a particular occupational 
career (that is, their employment goals) 



Data Sources 



Current Students, Exiting Students, Former Students 



Procedures 



Interviews; administration of a survey questionnaire 



Uses 



Institutional 



State 



Comments 



This measure was included in the original field review document, and has been 
pilot tested. 
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STUDENT SOCIAL ACTIVITY AND ROLE OUTCOME MEASURES 



QUESTIONNAIRE ITEMS FOR OUTCOME MEASURE O-i 

One procedure recommended for obtaining data for outcome measure 0-1 is the 
use of a survey questionnaire. Two alternative sets of questionnaire items 
have been developed for use in a survey of current jtudents, exiting students, 
or former students (graduates and nongraduates). 

Procedures for. a CURRENT-, EXITING-, or FORMER-STUDENT Questionnaire 

Two alternative sets of questionnaire items are presented for in(ilu5ion in 
a CURKENT-, EXITING-, or FORMER-STUDENT Questionnaire, Alternative #1 can 
be used if one is interested in knowing about the respondent's long-run 
career employer and the specific job position the respondent hopes to enter 
in his or her long-ru n occupational career . Alternative #2 can be useful if 
one is interested in knowing the respondent's intentions regarding his or her 
long-run career employer and the job activities the respondent intends to 
engage in during his or her long-run career. An advantage of the second 
alternative set of items is that th y are compatible with those used in the 
American Council on Education's longitudinal follow-up studies on college 
students. As a result, the results obtained from the use of these items can 
be compared to the ACE results referenced in Preventing College Dropouts 
(Astin, 1975) or by writing to Dr. Alexander Astin, Graduate School of 
Education, University of California at Los Angeles, California. 
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Alternative #1 



STUDENT SOCIAL ACTIVITY 'AND ROLE OUTCOME MEASURES 



1. We would like to find out about your long-run occupational career goals. 



Over the long-run , in which employment sector are you primarily 
interested in working? (PLEASE CHECK ONE) 

Long-run 

Career 

Employe. 

Federal — !°^! 

State _ (02 

Local _ (03) 

Elementary and Secondary ..... _ (04j 
Higher Education (0?) 

Hospitals, clinics (OS) 

Social Welfare — Sol 

Church : • • - • _ "° 

Other nonprofit organizations • • • )^^{ 

Self-employed or family business . _ (10) 

Private Company . yy 

Professional partnership ('^' 

Research J^^J 

Please specify vl*^) 



Government: 



Education: - 

Other Nonprofit 
Organizations: 



Business and Service: 



Other: 



From the list that appears on page , which c-ntry best 

describes your expected long-run career work? (Please write 
its3-digit code in the space below.) 



Long-run Occupational Career: 



Hdw sure are you of your choice in "b ? 
I 1 1(1 ) Quite sure 

[ j(2) Somewhat sure 

I |(3) Not sure 
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STUDENT SOCIAL ACIIVIIY ANU KULh UUILUMt ntM5UKt;> 
I Alternative #2 



1. 



We would like to find out about your long-runroccupational career goals 
and activities: 

a. In the long-run, whom do you expect will be your career emolover? 
(PLEASE CHECK ONE) 



Governmet t: 



Education: 



Other Nonprofit 
Organizations : 



Business and Service: 



Other: 



Long-run 

Career 

Employer 



Federal 

State [ 

Loca i - . 

Elementary. and Secondary . , 
Higher Education 

Hospitals , clinics 

Social Welfare 

Church 

Other nonprofit organizations.. - 
Self-employed or family business 

Private Cpmpany 

Professional partnership . . . . 

Research 

Please specify 



(01) 
(02) 
(03) 
04 



05 



(06) 
(07) 
(08) 
(09) 
(10) 
(11) 
(12) 
(13) 
(14) 



b. 



How much of your long-run career work do you expect will be devoted 
to each of the following job activities? (Please check one for each 
activity.) 



Job Activities 


Lonq-run Career Work 


(1) 
A Major 
Amount 


(2) 
A Minor 
Amount 


(3) 
None 


A. Teaching 








B. Research and Development 








C. 'Administrate' n or Management 








D. Service to customers, 
patients, or clients 








E. Other (Specifv) 
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STUDENT GENERAL KNOWLEDGE AND UNDERSTANDING MEASURES 



10.3100 

Outcome structure Category ^^-^^^^ 



p-i 



Measure 
Number 



Measure Name 



Tested breadth of knowledge and understanding 



Definition 



student scores or change in scores on standardized or instructor-developed tests 
that indicate development in their breadth of knowledge and understanding about 
facts, terminology, principles, processes, and/or theory across several broad 
fields of study (the humanities, the physical sciences," etc . ) 



Data Sources 



Current Students, Exiting Students, Former Students 



Procedures 



Administration of standardized achievement tests; administration of locally-developed 
achievement tests 



Uses 



Institutional 



Comments 



This measurs was ii^cluded in the original field review document 
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TUOENT GENERAL KNOWLEDGE AND UNDERSTANDING MEASURES 



ACQUISITION PKOChDUKES FOR UUTCOMt MEASURE P-1 



The data acquisition procedures most widely used to assess student development 
in their breadth of knowledge and understanding is the survey achievement test. 
(Some institutions and program staffs developed their own survey tests of 
knowledge because available standardized tests do not measure what is emphasized 
in their courses and programs.) Generally, such tests represent a standardized 
package of separate tests that cover the basic knowledge and skill components 
of the curriculum. Because a variety of standardized achievement tests already 
have been developed, NCHEMS has chosen to recommend their use in obtaining data 
for outcome measure P-1 . Probably the best source of information for deciding 
which achievement test best fits the situation in which it will be used is the 
series of Mental Measurements Yearbooks developed by Oscar K. Buros (1938, 1941, 
1949, 1953, 1959, 1965, 1972, 1978). The following achievement test batteries, 
which may be useful in obtaining outcome measure A-1, are reviewed in Volume I 
of the seventh edition of the Mental Measurement Yearbook: 



- Adult Basic Education Student Survey (Follet 
Educational Corporation, 1966-67) 

- Adult Basic Learning Examination (Harcourt, 
Brace, Jovanovich, Inc., 1967-71) 

- College-Level Examination Program General 
Examination (College Entrance Examination 
Board, 1970) 

- Survey of College Achievement (Educational 
Testing Service, 1966-69) 

- Tests of General Educational Development (The 
American Council on Education, 1970) 

- The Undergraduate Record Examinations: Area Tests 
(Educational Testing Service, 1954-70) 
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STUDENT SPECIALIZED KNOWLEDGE-AND UNDERSTANDING MEASURE 



10.3200 

Outcome Structure Category 25.2730 



Measure Name 

Tested specialized knowledge and understanding 



Definition 



student scores or change in scores from pre-test to post-test on standardized or 
instructor-developed tests that indicate development in their depth of knowledge 
and understanding concerning facts,, terminology, principles, processes, and/or 
theory in the particular fields in which students elect to study 



Data Sources 



Current Students, Exiting Students, Former Students 



Procedures 



Administration of standardized achievement tests; administration of locally- 
developed achievement tests 



Uses . 


Institutional 


State 


Comments 





This measure was included in the original field review document 
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Q-l 

Pleasure 
Number 



STUDENT SPECIALIZED KNOWLEDGE AND UNDERSTANDING MEASURES 



ACQUISITION PROCLDUKES FOR OUTCOME MEASURE Q-1 



Numerous standardized achievement tests have been developed to help assess student 
knowledge and skill development in special areas of study. Because of their 
existence, NCHEMS recommends their use in obtaining data for outcome measure A-2. 
As is true for outcome measure A-1 , Burros* Mental Measurements Yearbooks (1938, 
1941, 1949, 1953, 1959, 1965, 1972, 1978) are probably the best source of inform- 
ation for deciding which achievement tests best fit the situation in which they 
will be used. 

Where standardized tests do not measure the specialized knowledge emphasized in a 
program or course, locally-developed tests should be used. This is a quite common 
situation, and such tests are generally for most courses and programs at most 
institutions. The reliability and validitjij' of these tests should be evaluated, 
however, before much faith is placed in them. Volumes I and II of the seventh 
edition of the Mental Measurements Yearbook list standardized instruments for 
the following specialized fields of study: 



English 
Fine Arts 
Foreign Languages 
Mathematics 
Business Education 
Education 

Health and Physical 



Education 
Home Economics 
Industrial Arts 
Philosophy 
Psychology 
Religious Education 
Reading 
Biology 
Chemistry 
Geology 
Physics 



Economics 
Geography 
History 

Political Science 
Sociology 

Speech and Hearing 

Accounting 

Business 

Computer Programming 

Dentistry 

Engineering 

Law 

Medicine 

Nursing 

Selling 

Skill Trades 

Supervision 

Transportation 
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and Its Audience and Type-of-Outcome Categories 
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CODED LISTING OF THE SECOND- AND THI RD-LEVEL SUBCATEGORIES 
FOR EACH FIRST-LEVEL CATEGORY OF THE TYPE-OF-OUTCOME DIMENSION* 



CoSm'ber ^'^^"y ^••"0 Maintained or Changed 


Code Nun'Ier ^""^V ^^'n^ Maintained or Charge 


1000 ECONOMIC OUTCOMES 

1 1 00 Economic Access and independeric* Outcomes 
1110 Economic Access 

1 120 Economic Flexibility, Adaptability, and Security 
1 1 30 income and Standard o?JLiving 

1200 Economic Resources and Costs 

1210 Economic Costs and Eff.ciency 

1220 Economic Resources (including employees) 

1300 Economic Production 

1310 Economic Productivity and Production 
1 320 Economic Services Provided 

1400 Other Econcmlc Outcomes 


2000 HUMAN CHARACTEBISTIC OUTCOMES (continued) 
2760 Power and/or Authority 
2770 Job, School, or Life Succesa 

;i7C0 Other Status, Recognition, and &-rtl.lcatlon Outcomes 

2800 Social Activities ar<o Roles 

2810 Adjustment to Rati* ement 
2820 Afflliatlona 

2830 Avocatlujial and Social Activities and Rcles 
• 2940 Ca«*eer and Vocational a ^tivitles and Roles 
2850 Citizenship Activities and Roles 
2860' Family Activities and Roles 
2870 Friendships and Relationships 
2880 Other Activity ard RoleOutccmea 

2900 Other Human Characteristic Outcomes 


2000 HUMAN CHARACTBniSTIC OUTCOMES 

2100 Aspirations 

2110 Desires, Alms, and Q'^als 
2120 Dislikes, Likes, and interests 
2130 Motivation or Drive Level 
2140 Other Aspirational Outcomes 

2200 Competence and Skills 
2210 Academic SKIIIs 

2220 Citizenship and Family Membership SKlils 
2230 Creativity Skills 

2240 Expression and Communication Skills 
2250 ln!ellectual SKills 

2260 Intsrpersonal, Leadership, and Organizational Skills 
2270 Occupational and Employability CKIIIs 
2280 Physical and Motor SKIIIs 
2290 Other SKIM Outcomes 

2300 Morale. Satisfaction, and Affective Characteristics 
2310 Attitudes and Values 

2320 Beliefs, Commitments, and Philosophy of Life 
2*^0 Feeling s and E motion s 
2340 Mores, Customs, and Standards of Conduct 
2350 Other Affective Outcomea 

2400 Perceptual Characteristics 

2410 Perceptual Awareness and Sensitivity 
2420 Perception of Self 
2430 Perception of Others 
2440 Perception of Things 
2450 Other Perceptual Outcomea 

2500 Personality and Personal Coping Characteristics 
2510 Adventurousness and Initiative 
2520 Autonomy and Independence 
2530 Dependability and Responstbility 
2540 Dogmatic/Open«Minded, Authoritarian/Democratic 

25rr Habits 

2570 Psychological Functioning 
2580 Tolerance and Persistence 
2590 Other Personality and Personal Coping Outcomea 

2600 Physical and Physiological Characteristics 
2610 Physical Fitness and Traits 
2620 Physiological Health 
2630 Other Physical or Physiological Outcomes 

2700 Status. Recognition, andCerliflcattou 

2710 Completion or Achievement Award 
2720 Credit Recognition 
2730 Image. Reputation, or Status 
2740 Licensing and Certification 

2750 Obtaining a Job or Admission lo a Foilow-u p Program 


3000 KNOWLf-DGE, TECHNOLOGY, AND ART FORM OUTCOMES 

3100 Qe.ieial Knovi^ledge and Undefstandlng 

31 10 Knowledge and Understanding of General Facta «..id 
Tennlnology 

y 3120 Knowledge and Understanding of General Proceases 
1 3130 Knowledge and Understanding of Geiioral Theory 
3140 Other General Knowledge and Onderstandliig 
3200 Specialized Knowledge and Understanoing 

3210 Knowledge and Understanding of Spectalized Facts 

and Terminology 
3220 Knowledge and Understandicg of Specialized 
Processes 

3230 Knowledge and Unde* standing of Specialized Theory 
3240 Other Specialized Knowledge and Un.srsi^ndlng 

3300 Research and Schoiarship 

3310 Research and Scholarship Knowledge and 

Understanding 
33?0 Research and Scholarship Products 

3400 Art Forms and Works 
3410 Architecture 
3420 Dance 
3430 Debate and Oratory 
3440 Drama 

3450 Literature and Writing 
3460 ^usic 

3470 Painting, Drawing, and Photography 
3460 Sculpture 
3490 Other Fine Arts 

3500 Other Knowledge, Technology, and Art Form Outcomes 


4000 RESOURCE AND SERVICE PROVISION OUTCOMES 

4100 Provision of Facilities and Events 
4110 Provision of racillties 
4120 provision or Sponsorship of Events 

4200 Provision of Direct Services 
4210 Teaching 

4220 Advisory and Analytic Assistance 
4230 Treatment, Care, and Refenal Sen/ices 
4240 Provi slon of Other Services 

4300 Other Resource and Service Proviaton Outcomes 


5000 OTHER MAINTENANCE AND CHANGE OUTCOMES 
5100 Aesthetic-Cultural Activities, Tr«jltions. and Conditions 
5200 Organizational Format, Activity, and Operation 
5300 Other Maintenance and Change 



• Tht fourth I9V0I cattgoriei. mio which any o» the cattgor.ts listed h«rt can t>* divided, art ■•maintenanca ' (a fou'th dtgit of "I") and "changr' (a 



SUBCATEGORIES OF THE "AUD.ENCE" DIMENSION 

*0 indiviautf/Group C//«nfs--This ca(«QOry rtfars to parsons or groups of persons rho ara diract clients ot tha postsacon'lary aducation unit of 
concarn and/or thair immadiata associatas. sucf) as family and ralativas or pears. 

11 Sfuoranfs»lfKllviduals or groups of lr>dtvlduals whocurrantlyaraanroilad In tha program, Institution, or systam of postsacondary education 

12 former Sfudanrs-^lndMduals Of groups of individuals who formerly weraenrjiled in the program, institution, or system of postsecondary 
education 

13 famt/y a/rtf /9a/ar/v9S of Sfuc^fs or Former Stu<f9nt$ 

14 Peers antf Assoc/afes of Studtttt or Forrrm Stu<f9nt$ 
l5. Faculty 

16 Stiff Othfthtn fKulty 

17 Othf tndtvMiutt /Group C//enrs^An example would be an individual who is none of the above;t>ut.ls served by erf advisory service offered 
by the college. 

20 /nreresr-8asetf Commun/f/as^This category refers to large groups that are identifie<tas entitles wor>(ing toward a mU-d»fm9d inferesf or 

• mitt ion 



21 



Pr/vafa £nt§fpnf Communfffes^Communities where a major purpose Is financial remuneration and profit—for example, corporations, 
small businesses, and farmers 



22 Associaf/on Communifias— Communities where nftembers belong on tha basis of affiliation rather than employment, such as unions and 
professional societies. 

23. Govemmertf Communffias^Communities ((esigned to edminister government regulations and services, such as city hall, state department 
of education, and legislative communities 

24 Nor)govmm»r)fl/Putlic Service Commumf/es Ottmr fftan tfw /nsf/fufjn Producing fAa Oufcoma— Nonprofit service organizations, such 
as schoots, hospitals, welfare agencies, philanthropic foundations, colleges (other than tha college producing the outcome), and research 
organizations 

25 institution or ln%titution%l Unit PfOduang th9 Oufcome— The postsecondary education institution and/ or units within that institution that 
are perceived as the producer/ facilitator of the outcofne<s) of concern. 

26 C/Aer /nftrtsr-SasetfCommuniffes^An example would be an ad hoc coalition task force of representatives from two or more of theebove 
areas. 

30 G»ogr»phic-B»$9d Com/nun /f«es— This category refers to large groups defined on the basis of funetion»l t^rrftorml boundtrtes 

31 Iocs/ Community— A township, city, county, metropolitan area, or other type of locality having particular boundaries It is not necessarily 
restricted to the legal or jurisdictional boundary, but the functional one in which the impact of tha institution is (or should be) directly and 
physically felt The boundaries will vary with tfie institution /program arxj outcome of concern 

32 Tht Sfafa 

33 A Peg^on— An aggregation of states or pans of states 

34 Th» N9tion 

35 An lnt9fn»tio ntt Community 

36 Of^er G^ogrtphicBtttd Corr.muniti99—An example would be a research discovery that affects primarily people living in the coldest 
latitudes, or wt^a it sr>ows heavily 

40 Aggrtgafas of Peop/e— This category rafera to subpopulations of q90Q\» dutmguithtd by pMrticulMr cfmr§ct»ristic9 th»t /nay indtcsf common 
concerns, needs, or wanfs, but who do not necessarily have a common interest or mission, and therefore do not constitute communities 



41 


A^f//fy Lave/ Su6popu/af/OAs ^Subpopulations defined according to le^ 
specific skiiis->for example, gifted, typical, disadvantaged, or skilled, sen 


Ml of sbility/proficiency on generel intellectual functioning or 
li-skilled, unskilled 


42 


Age SubpOf>ul9tions 




43 


Eaucttionti LmfBt Subpopulttiont 




44 


fncome Ltvf SubpopuMton$ 




45 


Occupation Subpopul»tion$ 




46 


Phync^f Oifbility Condition Sutpoput§tiont 




47 


Aaca SubQopulttiont 




46 


Sex Subpopulttions 




49 


Ottm Such Aggregefes 





50 Oth^r Ai/d^ces— Exemples would be the natural environment that is affected by university-sponsored research (which m turn would be 
expected to have impacts on audiences such as individuals and communities) end populations of animals (such as the animals affected by 
efforts to keep depleted species from becoming extinct or by the development of veterinary medicines) 



o ■ 

ERIC 



-288- 



238 



I 



■list A: MAJORS AND AREAS OF STUDY 

Programs usually requiring four or more years of study 



APPENDIX B 

Lists of Areas of Study and Occupational Titles^ 

LIST B: OCCUPATION AL TITLES 



3100 Agriculture and Natural Resources 

3200 Architecture and Environmental Design 

"0300 Area Studies (includes Asian Studies. Black Studies, etc ) 

J)400 Biological and Life Sciences 

)500 Business and Management 

3600 Communications 

0700 Computer and Information Sciences 

3800 Education 

3900 Engmeenng 

1000 Fine and Applied Artsdncludes Art, Dance, Drama, Music, etc ) 

1100 Foreign Languages 

11200 Health Professions 

1300 Home Economics (includes Clothing and Textiles, Institutional 

Housekeeping, and Food Service Management, etc ) 

1400 Law 

1500 Letters (includes Creative Writing, Literature, Philosophy, 

Speech, etc ) 

16(X) Library Science 

^1700 Mathematics 

11800 Military Sciences 

Il900 Physical Sciences (includes Chemistry, Physics, Earth 

Sciences, etc ) 

12000 Psychology 

I2IOO Public Affairs and Social Services 

'2200 Social Sciences (includes Anthropology, Economics, 

History. Political Science, Sociology, etc ) 

12300 Theology and Religion 

|4900 Interdisciplinary Studies 

6000 Other 

.7000 Undecided but probably program of four or more years 



\ Programs usually requiring less thar) four years of study 



i5000 Business and Commerce Technologies (includes Accounting, 
Banking, Commercial Art, Hotel and Restaurant Management, 
etc) 

5005 Secretanal Technologies (includes Office Supervising and 
Management, Stenographic and Typing Technology, etc ) 
15006 Personal Service Technologies (includes Stewardess Training, 

Cosmetologist, etc ) 
5100 Data Processing Technologies (includes Computer 

Programming, Keypunching, etc ) 
15200 Health Services and Paramedical Technologies (includes 

Dental and Medical Assistant Technology, LPN, Occupational 
and Physical Therapy Technology, etc ) 
|5300 Mechanical and Engineering Technologies (includes 
Aeronautical and Automotive Technology, Welding, 
Electronics, Architectural Drafting, etc ) 
|5317 Construction and Building Technologies (includes Carpentry. 

Plumbing, Sheet Metal, Heating, etc ) 
' j400 Natural Science Technologies (includes Agnculture Technology, 
Environmental Health Technology, Forestry and Wildlife 
Technology, etc ) 
1 5404 Food Services Technologies (includes Food Service 

Sup^ -vising. Institutional Food Preparation, etc ) 
5500 Public Service Technologies (includes Law Enforcement 

Technology, Teacher Aide Training, Fire Control Technology, 
Public Administration Technology, etc.) 
5506 Recreation and Social Work Related Technologies 
•"g" Other 

|^(]] Undecided but probably less than four year program 



01 Agricultural and Forestry Occupations, Fishers, and Hunters 

02 Clerical Occupations 

03 Construction, Dniling, and Mining Occupations 

04 Engineers and Architects 

05 Executive, Administrative, and Managenal Occupations 

06 Health-Diagnosing and Treating Practitioners 

07 Health Technologists and Technicians 

08 Marketing and Sales Occupations 

09 Material Handlers, Equipment Cleaners, and Laborers 

10 Mechanics and Repairers 

11 Military Occupations 

1 2 Natural Scientists and Mathematicians 

1 3 Nurses, Pharmacists, Dietitians, Therapists, and Physicians' 
Assistants 

1 4 Production Occupations (Occupations concerned with 
setting up, operating, or tending of machines and with 
hand production, usually in a factory ^ shop) 

1 5 Service Occupations 

16 Social Scientists, Social Workers, Religious Workers, and 
Lawyers 

17 Teachers, Librarians, and Counselors 

18 Technologists and Technicians (except Health) 

1 9 Transportation and Material-Moving Occupations 

20 Wnters, Artists. Editors, and Athletes 

21 Other 



These lists were developed for use in the 
questionnaires of the Student Outcomes 
Information Services (SOIS) Program 
sponsored jointly by NCHEMS and the College 
Entrance Examination Program (Gray and 
Others 1979). 
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APPENDIX C 



THE HEGIS TAXONOMY* 



In view of the length and comprehensive nature of the Taxonomy of Instructional 
Programs, it may sometimes be diffucult to locate the appropriate reporting 



title for a specific instructional program.' Tw facilitate the location pro 
cess, a summary list of the program categories (discipline categories) is 
shown b^low. 



PROGRAM (DISCIPLINE) Cj\TEGORIES 



(Conventional academk subdivisions of knowledge tmd 

training) 

Code 



0000 GENERAL 

0100 AGRICULTURE and NATURAL RESOURCES 
0200 ARCHITECTURE and ENVIRONMENTAL 

DESIGN 
0300 AREA STUOIES 
0400 BIOLOGICAL SCIENCES 
0500 BUSINESS and MANAGEMENT 
0600 COMMUNICATIONS 
0700 COMPUTER and INFORMATION SCIENCES 
0800 EDUCATION 
0900 ENGINEERING 
1000 FINE and APPLIED ARTS 
1100 FOREIGN LANGUAGES 
1200 HEALTH PRrFESSIONS 
1300 HOME ECONOMICS 
1400 LAW 
1500 LETTERS 

1600 library science 
1700 mathi:matics 
1800 military sciences 
:900 physical sciences 
2000 psychology 

2100 PUBLIC AFFAIRS and SERVICES 
2200 SOCIAL SCIENCES 
2300 THEOLOGY 

4900 INTERDISCIPLINARY STUDIIlS 



^Source: Robert A. Huff and Marjorie 0. Chandler, A Taxonomy of Instructional 
Programs in Higher Education (Washington, D.C.: National Center for Educa- 
tional Statistics, Office of Education, 1970). 
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(Technplogical and ocatpaflonal specialties related to cuf^ 
riculums leading to associate degrees and other awards 
below the haccalatireate) 

Code 

5000 BUSINESS and COMMERCE TECHNOLOGIES 
5100 DATA PROCESSING TECHNOLOGIES 
5200 HEALTH SERVICES and PARAMEDICAL 

TECHNOLOGIES 
5300 MECHANICAL and ENGINEERING 

TECHNOLOGIES 
5400 NATURAL SCIENCE TECHNOLOGIES 
5500 PUBLIC SERVICE RELATED TECHNOLOGIES 



P ROGRAM (DISCIPLINE) SUBCATEGORIES 

A listing of all probram (discipline) subcategories is given below by discipline 
categories. This section is included for purposes of definition to indicate 
which specific program subcategories are included in each program category. 



I 



OOOO GENERAL USE 

0100 AGRICULTURE AND NATURAL RESOURCES 

0101 Agriculture, General 

0102 Agronomy (Field Crops, and Crop 

Mnnngemcnt) 

0103 Soils Science (Management and Conservatico) 

0104 Animal Science (Husbandry) 

0105 Dairy Science (Husbandry) 

0106 Poul:ry Science 

0107 Fish, Game, and Wildlife Management 

0108 Horticulture (Fruit and Vegetable I 

Production) " 

0109 Ornamental Horticulture (Floriculture, 

Nursery Science) 

0110 Agricultural and Farm Management 

0111 Agricultural Economics 

0112 Agricultural Business 

0113 Food Science and Technology 
or Foicstry 

OK Natural Resources Management 

0116 Agriculture and Forestry Technologies 

0117 Range Management 
0199 Other, Specify 

0200 ARCHITECTURE AND ENVIRONMENTAL DESIGN 

0201 Environmental Design, General 

0202 Architecture 
02')3 Interior Design 

0204 TandsciiH: Architecture 

02)5 Uib;in Architecture 

02(16 City, Community, and Regional Planning 

02V9 Other, .^Jpccify 

0300 AREA STUDIES 

03U1 Abian Stuuics, General 

0302 East Asian Studies 

0303 South Asian (India, etc.) Studies 

0304 Southeast Asian Studies 

0305 African Studies 



0306 Islamic Studies 

0307 Russian and Slavic Studiei 

0308 Latin American Studies 

0309 Middle Eastern Studies 

0310 European Studies, General 

0311 Eastern European Studies 

0312 West European Studies 

0313 American Studies 

0314 Pacific Area Studies 
0399 Other, Specify 

0400 BIOLOGICAL SCIENCES 

0401 Diclogy, General 

0402 Botany, General 

0403 Bacteriology 

0404 Plant Pathology 

0405 Plant Pharmacology 

0406 Plant Physiology 

0407 Zoology, General 

0408 Pathology, Human and Animal 

0409 Pharmacology, Human and Animal 

0410 Physiology, Human and Animal 

041 1 ^licrobiology 

0412 Anatomy 
041 , Histology 

0414 Biochemistry 

0415 Biophysics 

0416 Molecular Riology 

0417 Cell Uiology (Cytology, Cell Physiology) 
04 IK Marine Uiology 

0419 Biometrics sind Riostntistics 

0420 Ecology 

0421 Entomology 

0422 Genetics 

0423 Rr.diobioloiiy 

0424 Nutrition, Scientific 

(exclude Nutritioa in Home Economtci 
and Dietetics) 
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0425 Neuroscienccs 

0426 Toxicology 

0427 Embryology 
0499 Other, Specify 

0500 BUSINESS AND MANAGEMENT 

0501 Business nnd Commerce, General 

0502 Accounting 

0503 Business Statistics 

0504 Bnnking and Finance 

0505 Investments and Securities 

0506 Business Management and Administration 

0507 Operations Research 

0508 Hotel and Restaurnni Management 

0509 Marketing and Purchasing 

0510 Transportation and Public Utilities 
G5II Real Estate 

0512 Insurance 

0513 International Business 

0514 Secretarial Studies 

0515 Personnel Management 

0516 Labor and Industrial Relations 
05)7 Business Economics 

0599 Other. Specify 

0600 COMMUNICATIONS 

0601 Communications, General 

0602 Journalism (Printed Media) 

0603 Radio/TV 

0604 Advertising 

0605 Communication Media 

(use of videotape, film, etc., 
i^r^ented specifically toward radio/TV) 

0699 Olher» Specify 

0700 COMPUTER ANO INFORMATION SCIENCES 

0701 Computer and Inforn^ition Sciences, General 

0702 Information Sciences and Systems 

0703 Data Processing 



0704 


Computer Programming 


0705 


Systems Analysis 


0799 


Other. Specify 


0800 EOUCATION 


0801 


Education, general 


0R02 


Elemenlaiy education, general 


0803 


Secondary education, general 


0804 


Junior high school education 


o:<05 


Higher education, general 


0R06 


Junior and community college education 


0807 


AtUilt and continuing education 


080R 


Special education, general 


0H09 


AdiumiM^ation of special education 


0810 


Ptlncation of the mentally retarded 


0811 


Fdiication of the gifted 


0812 


Pxlucahon of the deaf 


0813 


nUiication of tlic culturally disadvantaged 


0814 


Education of the visually handicapped 


0815 


Speech correction 


0816 


Education of the emotionally disturbed 


0817 


Remedial education 



0818 Special learning disabilities 

0819 Education of the physically handicapped 

0820 Education of the multiple handicapped 

0821 Social foundations (history and philosophy 

of education) 

0822 Educational psychology (include learning 

theory) 

0823 Prc-clementary education (kindergarten) 

0824 Educational statistics and research 

0825 Educational testing, evaluation, and 

measurement 

0826 Student personnel (counseiing and guidance) 

0827 Educational administration 

0828 Educatk^nal supervision 

0829 Curriculum and instruction 

0830. Reading education .(methodology and theory) 

0831 Art education (methodology and theory) 

0832 \lusic education (methodology and theory) 

0833 Mathematics education 

(methodology and theory) 

0834 Science education (methodology and theory) 

0835 Physical education 

0836 -Driver and safety education 

0837 Health education (include family life 

education) 

y 0838 Business, commerce, and distkibutive education 
i 0839 Industrial arts, vocational, and aechnScal 
education 
0899 Other, specify 

0900 ENGINEERING 

0901 Engineering, General 

0902 Aerospace, Aeronautical, and 

Astronautical Engineering 

0903 Agricr' ural Engineering 

0904 Architectural Engineering 

0905 Bioengincering and Biomedical Engineering 

0906 Chemical Engineering (include Petroleum 

Refining) 

0907 Petroleum Engineering (exclude Petroleum 

Refining) 

0908 Civil, Construction, and Transportation 

Engineering 

0909 Electrical, Electronics, and Communications 

Engineering 

0910 Mechanical Engineering 

0911 Geological Engineering 

0912 Geophysical Engineering 

0913 Industrial and Management Engineering 

0914 Metallurgical Pngineering 
091. S Materials P.npineering 

0916 Ceramic Tngineering 

0917 Textile Engineering 

0018 Mining and Mineral Engineering 
D9I9 Engineering Physics 

0920 Nuclear Engineering 

0921 Engineering Mechanics 

0922 Environmental nnd Sanitary Engineering 

0923 Naval Architecture and Marine Engincenng 

0924 (kean Engineering 
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0925 Knginocnng fcchnologies 
0999 Other, Spccity 

'!000 FINE AND AP^^lEO ARTS 

1001 I-mc Ait\ Gcncnil 

1002 Art (Piiiniinp, Drawlnc, Sculpture) 

1003 Ail Ilistory ;irKl Appreciation 

1004 Music ( Pciforniing, Composition, Theory) 

1005 Miiiic (Liberal Arts Program)* 

1006 Music History and Appreciation 

(Musicology) 

1007 Dramatic Arts 

1008 Dunce 

1009 Applied Design 

(Ceramics, Weiaving, Textile Design, 
Fashion Design, Jewelry, Melabmilbiog, 
Interior Decoration, Comrrercial Ari) 

1010 Cinematography 

1011 Photography 
1099 Other, Specify 

1100 FOREIGN LANGUAGES 

1 1 01 Foreign Languages, General 

1 102 French 

1103 German 

1 104 Italian 

1 105 Spanish 

1 106 Russian 

1107 Chinese 

1 108 Japanese ^ 

1109 Latin 

1110 Greek, classical 
nil Hebrew 

1 1 12 Arabic 

1113 Indian (Asiatic) 

1 1 1 » Scitndinavian Languages 

1 1 15 Slavic Languages (other than Russian) 

1 1 16 African Languages (non<Scmitic) 
1199 Other, Specify 

1200 HEALTH PROFESSIONS 



I 



1300 HOME ECONOMICS 



1301 Home Economics, r>encral 

1302 Home r^ccor.ition and Home Equipment 

1303 Clolhinp and lexliles 

I3t)4 ConNunicr I'cimomics and Home Management 

1305 Fannly Relations and Child Development 

1306 Foods and Nutrition (include Dietetics) 

1307 Institutional Management and Cafeteria 

Management 

1399 Other, Specify 

1400 LAW 

I40I Law, General 
1499 Other, Specify 

1500 LETTERS 

1501 English, General 

1502 Literature, English 

1503 Comparative Literature 

1504 Classics 

1505- Linguistics (include Phonetics, Semantics, 
and Philology) 

1506 Speech, Debate, and Forensic Science 

(Rhetoric and Public Address) 

1507 Creative Writing 

1508 Teaching of English as a Foreign Language 

1509 Philosophy 

1510 Religious Studies (eJ jde Theological 

Professions) 
Other, Specify 



i2o: 

1202 
1203 
1204 
1205 
1206 
1207 
I2J8 
1209 
1210 
I2II 
1212 
1213 
1214 
1215 
1216 
121? 
i:iH 
1219 
1220 
1221 
1:22 
1223 
1224 
1225 
1299 



Health Professions, General 

Hospital and Health Care Administration 

Nursing 

Dentistry 

Denial Specialties 

Medicine 

Medical Specialties 
Occupational Therapy 
Optometry 

Osteopathic Medicine 
Pii:irinacy 
physical *l herapy 
IX'iil.il Hygiene 
Public Health 

Medical Record Librarianship 
Podiatry or Podiatric Medicine 
Hiomcdical Communication 
Veierinary Medicine 
Veterinary Medicine Specialticj 
Speech Pathology and Audiology 
Chiropractic 
Clinical Social Work 
Medical l.ahoiatory Teehnotogie: 
Denial Technologies 
Radiologic Technologies 
Other, Specify 



1599 

1600 LIBRARY SCIENCE 

1 60 1 Library Science, General 

1699 Other, Specify 

1700 MATHEMATICS 

1701 Mathematics, General 

1702 Statistics, Mr.'hematical and Theoretical 

1703 Applied Mathematics 
1799 Other, Specify 

1600 MILITARY SCIENCES 

1801 Military Science (Army) 

1802 Naval Science (Navy, Marines) 

1803 Aerospace Science (Air Force) 
1899 Other, Specify 

1900 PHYSICAL SCIENCES 

1 90 1 Physical Sciences, General 

1902 Physics. General (exclude Biophysics) 

1903 Molecular Physics 

1904 -Nuclear Physics 

1905 Chemistry, General (exclude Biochemistry) 

1906 Inorganic C Miiistry 

1907 Oig.inic Cheinibtiy 
I90H Physical Chemistry 

1909 Analytical Chemistry 

1910 Pharmaceutical Chemistry 

191 1 Astronomy 

1912 Astrophysics 

19 1 3 Atmospheric Sciences tnd Meteorology 

19 14 Geology * 

1915 Geochemistry 

1916 Geophysics and Seismology 

1917 Earth Sciences, General 

1918 Paleontology 

1919 Oceanography 

1920 Metallurgy 
1999 Other, Specify 
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2000 PSYCHOLOGY 

2001 Psychology. General 

2002 Expcrimcnlal Psychology (animal and 

hiimnnj 

2003 Clinical Psychotogy 

2004 Psychology for Counseling 

2005 Social Psychology 

2006 P^ychomclrics 

2007 SintiMics in Psychology 

2008 Iniluslrinl Psychology 

2009 Dcvelopmcntnl Psychology 

2010 Phy5iologic it Psychology 
2099 Other. Spcnfy 

2100 PUBLIC AFFAIRS AND SERVICES 
7101 CommimHy Services. General 

2102 Public Adininlslralion 

2103 - Parks and Kecreaiton Management 

2104 Social Work and Helping Services 

(other than Clinical Social Work) 

2105 Law Enforcement and Corrections 

2106 Intcrnatfonal PObltc Service 

(other than Diplomatic Service) 
2199 Other. Specify 

2200 SOCIAL SCIENCES 

2201 Social Sciences. General 

2202 Anthropology 

2203 Archeology 

2204 Economics 

2205 History 

2206 Geography 

2207 Political Science and Government 

2208 Sociology 

2209 Criminnlogy 

2210 International Relations 

22U Afro-American (Black Culture) Studica 

2212 American Indian Cultural Studies 

2213 Mexican- American Cultural Studies 

2214 Urban Studies 

2215 Dcmogniphy 
2299 Other. Specify 

2300 THEOLOGY 

2301 Theological Professions, General 

2302 Rclicioiis Music 

2303 Rihiical Languages 
23U4 Religious Education 
2399 Other. Specify 

4900 INTERDISCIPLINARY STUDIES 

4001 Ctcncial IJhcral Arts ami Sciences 

4002 Itioloi'icnl ami Physical Sciences 
4001 IhiMKMiilics jNul Swial Sciences 
4004 l'n;:incciMit; ami Otiicr Disciplines 
40'>0 Olhci. SiHTCify 

5000 BUSINESS AND COMMERCE TECHNOLOGIES 

5001 llusincss and Commerce Technologies, 

Ctciicral 

5002 Account inn Tcclinolopics 

5003 iLinkinu ami I nance Technologies 

5004 M.irkciinp. Distrihulion, Purchasing. Business, 

ami Industrial Management Technologies 

5005 Secretarial Tcclinolofiies 

(include OfBce Machines Training) 

5006 Personal Service Technologies 



Ieric 



(Stewardess. Cosmetologist, etc.) 

5007 Photography Technologies 

5008 Comiiuinicalions and Rroadc.isting 

Technologies (R.idio/TV. Newspapers) 

5009 Printing and l ithography Technologies 

5010 Hotel and Restaurant Management 

Technologies 

5011 Transportation and Public Utility 

Technologies 

5012 Applied Arts. Graphic Arts, and Fine Arts 

Technologies (include advertising design) 
5099 Other. Specify 

5100 DATA PROCESSING TECHNOLOGIES 

5101 Dgta Processing .Tcchnotogies, General 

5102 Key Punch Operator and Other Input 

Pixrparalion Technologies 

5103 Computer Programmer Technologies 

5104 Computer Operator and Peripheral Equipment 

Op<rration Technologies 
5r05 DaUi Processing Equipment Maintenance 

Technologies 
5199 Other. Specify 

5200 HEALTH SERVICES AND PARAMEDICAL 
TECHNOLOGIES 

52CI Health Services Assistant Technologies, 
General 

5202 Dental Assistant Technologies 

5203 Dental Hygiene Technologies 

5204 Dental I.iihoratory Technologies 

5205 Medical or Biological Laboratory Assistant 

Technologies 

5206 Animal I.aborn?ory Assistant Technologies 

5207 R.idiologic Technologies (X-Ray, etc.) 

5208 Nursing, R.N. (less than 4-year program) 

5209 Noising. Practical (L.P.N, or L.V.N.— less 

than 4-ycar program) 

5210 Occupational Therapy Technologies 

5211 Surgical Technologies 

5212 Optical Technologies (include Ocular Care, 
Ophthalmic. Optometric Technologies) 

5213 Medical Record Technologies 

5214 Medical Assistant and Medical Office 

Assistant Technologies 

5215 fnh.ilation Therapy Technologies 

5216 Psychiatric Technologies (include Mental 

Health Aide Programs) 

5217 Electro Diagnostic Technologies 

(include E.K.G., E.E.G., etc.) 
5? 18 Institutional Management Technologies 

( Rest Ihimc, etc.) 
.^21*) Phvsical Ihcrapy Tcchnnl(H:ics 
52')') Other. Specify 

5300 MECHANICAL AND ENGINEERING TECHNOLOGIES 
5}0\ Mccli.inical and l*nginccring Technologies, 
OcMcral 

5302 Aeronautical and Aviation Technologies 

5303 linpncciini; (Jraphics (Tool ami Machine 

Drafting and Hcsign) 

5304 Architectural Diafting Technologies 

5305 Chemical Technologies (include Plastics) 

5306 Automotive Technologies 

5307 Diesel Technologies 

5308 Welding Technologies 
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5309 Civil Technologies 

(Siiivcyjng, IMiutogramnictry, etc.) 

5310 ntcclionicb anil M;ichinc Technologies 

(TV, Appli;inec, Office Muchinc Repair, 
etc.) 

5311 Electromechanical Technologies 

5312 Initiistrial Technologies 

5313 Textile Technologies 

5314 In^lriimentntion Technologies 

5315 Mechanical Technologies 

5316 Nuclear Technologies 

5317 Construction and Building Technologies 

(Carpentry, Electrical Work, Plumbing, 
Sheet Metal, Air Conditioning, Heating, 
etc.) 

5399 Other, Specify 

5400 NATURAL SCIENCE TECHNOLOGIES 

540 1 Natural Science Technologies, General 

5402 Agriculture Technologies 

(include Horticulture) 

5403 Forestry and Wildlife Technologies 

(include Fisheries) 

5404 Food Services Technologies 

5405 Home Economics Technologies 

5406 M;irine and Oceanogrnphic Technologies 

5407 Laboratory Technologies, General 

5408 Sanitation and Public Health Inspection f 

Technologies (Environmental Health 
Technologies) 
5499 Other, Specify 

5500 PUBLIC SERVICE RELATED TECHN04.0GtES 

5501 Public Service Technologies, General 

5502 Bible Study or Religion-Related Occupations 

5503 Education Technologies (Teacher Aide and 

2-year Teacher Training Programs) 

5504 Library Assistant Technologies 

5505 Police, Law Enforcement, Corrections 

Technologies 

5506 Recreation and Social Work Related 

Technologies 

5507 Fire Control Technology 

5508 Public Administration and Management 

Technologies 
5599 Other, Specify 
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ALPHABETICAL LISTING 



For the user's convenience, the HEGIS discipline subcategories are listed 
below in «ilphabetical order. 



Part 1: 

CONVENTIONAL ACADEMIC SUBDIVISIONS 
KNOWLEDGE AND TRAINING 



OF 



Title 



Code 



Accounting 0502 

Administration, business 0506 

Ailiiiinistration, educational 0827 

Adiiiinistration, public 2102 

Administration, special education 0809 

Adult education ^ 0807 

Advertising ^ ^ ^ 0604 

Aeronautical engineering ^...0902 

Aerospace engineering ^ ^..-.0902 

Aerospace science 1803 

African languages (non-Semitic) 1116 

African studies 0305 

Afro-American studies ^ ....221! 

Agricultural business ^ 0112 

Agricultural economics «..OIII 

Agricultural engineering 0903 

Agricultural management 0110 

Agriculture, general 0101 

Agriculture technologies 0116 

Agronomy 0102 

American Indian cultural studies 2212 

American studies ....0313 

Analytical chemistry 1909 

Anatomy « .....0412 

Animal science 0104 

Anthropology 2202 

Applied design 1009 

Applied mathematics 1703 

Arabic 1112 

Archeology 2203 

ArchtlccturnI engineering 0904 

Architecture 0202 

Architecture, naval 0923 

Art _.1002 

Art appreciation 1003 

Art, commercial ».1009 

Art education 0831 

Art hiMory 1003 

Asian studies, general 0301 

Astronnutical engineering 0902 

AMioiinmy ^ 1911 

AMropliysic% 1912 

Atmovphertc sciences 1913 

Audiolopy !.I220 

Ibiltiiolojjy 0.^03 

0504 

Hihlicnl lanpti:igcs 2303 

niocliciniMry !"04I4 

HicKnpirKcrtng ] "I..0905 

Mrolopical and physical sciences (interdisciplinary) ...„!4902 

Riolopy, cellular !!!0417 

lliolopy, general !Z....'Zlo40l 

Biolopy, marine 041g 

Biology, molecular 0416 



Biomedical communication 1217 

Biomedical engineering 0905 

Biometrics 0419 

Biophysics * 0415 

Biostatistics 0419 

Black culture studies 2211 

Botany, general -. '....,0402 

Business administration 0506 

Business, agricuftural 0112 

Business economics ..,.0517 

Business education ^ 0838 

Business, general : 0501 

Business, international ^ ^ 0513 

Business management ^ ..,..,0506 

Bus iness statistics .....^ .'!!..!o503 

Cafeteria management 1307 

Catalan^ Z"Z];!Zll99 

Cell bidlogy 04I7 

Cell physiology !"04I7 

Ceramic engineering 0916 

Ceramics !.!l009 

Chemical engineering 0906 

Chemistry, general !!l905 

Child development |305 

Chinese ^ .!!!ll07 

Chiropractic „ |22l 

Cinematography |0I0 

City planning "....!!Z.0206 

Civil engineering 0908 

Clas.^cs 1 504 

Clinical psychology 2003 

Clinical social work ^ |222 

Clothing .."..1303 

Commerce education 0838 

Commerce, general 0501 

Commercial art |009 

Communication media 0605 

Communications, general 0601 

Communications engineering ^ 0909 

Community college education 0806 

Community planning 0206 

Community services, general 2101 

Comparative literature 1503 

Comouter programming ^ 0704 

Computer sciences, general 0701 

Construction engineering 0908 

Consumer economics 1304 

Continuing education ^ 0807 

Corrections 2105 

Counseling, cducati^inal 082f» 

Coii.iscling, psychology for 2004 

C'rcnlivc writing | so7 

Criii»iiM»logy ....22iV) 

Crop ninnagcment oi02 

Curriculum og29 

Cytology 3.04 1 7 

Dairy sciences ^ .^...0105 

Dance ...["I!!!. J 008 

Danish ^ 1114 

Data processing „ 0701 

Deb«te _ 1.;1!!.'!;I1j306 
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Dcniocr.iphy 2215 

ncnt.il hyiiicnc 1213 

Denial spcciallics 1205 

IVnt.il kchnoloiiics 1224 

DcnliMry. D.D S. or O.M.D. dctiicc 1204 

Dcvclopincnl.'.l psychology ?.009 

Dietetics 1306 

Distributive cihtcntion 0:08 

Dramatic arts 1007 

Di awing 1002 

Driver education OS36 

Earth sciences, general ^ « 1*^17 

East Asi.in studies 0302 

Eastern F.uropean studies 0311 

Ecology 0420 

Economics 2204 

Economics, agricultural '. 0111 

Economics, business 0517 

Education of the culturally disadvantaged OH 13 

Hducahon of the deaf 0812 

Education of the emotionally disturbed 0816 

Educattrn, general OKOI 

r.iUicatton of Ihe gifled 0811 

Education of mentally retarded 0810 

Education of the multiple handicapped 0820 

Fducation of the physically handicapped 0819 

Education, religions 2304 

Education of the visually handicapped 0814 

Educational ailniinist ration 0827 

Educational evaluation 0825 jf 

Educational measurement 0825 

Educational psychology 0822 

Educational research 0824 

Educational .statistics 0824 

fidticationttl supervision —.. 0828 

Educalional testing 0825 

Electrical engineering 0909 

Electronics enci nee ring 0909 

Elementary education, general 0802 

Emhiyology 0427 

Engl nee rinr:. general 0901 

Engmccrinr. mechanics 0921 

Enyineenni: and other disciplines (interdisciplinary) ....4904 

Enyinec fine physics 0919 

nngmeenni' technologies 0925 

Englrsh as .\ foreign language 1508 

English, general 1501 

English, liicralure 1502 

EniomolocN 0421 

Enviromnciilal design, general 0201 

Environininlal engineering 0922 

Europian suiihcs, general 0310 

l:x|H'iiineni.tl psychology (animal and human) 20t12 

1 .iinily life iiliicalion 0837 

r.iniily iclalions 1305 

I'.iiin inan.igctitent 0110 

iMshion doign 1009 

VivUi crops 0102 

f iii.ince 0504 

Tine arts, general 1001 

Finnish 1199 

Fish management Or07 

Floricullure 0109 

foods and nutrition 1306 

Food sctwnce 0113 



Food technology 0113 

Foicigii languages, general ... . 1101 

Fouiisic science 1506 

Fou-sdy ... 0114 

Forcstiy technologies 0116 

French 1102 

Fiuit proiluclion 0108 

Came management 0107 

General liberal arts and sciences (interdisciplinary) ....4901 

Genetics 0422 

Geochemistry 1915 

C.o«»raphy 2206 

Geological engineet 0911 

Geology - 1914 

Geophysical engineering 0912 

Geophysics 1916 

German , 1103 

• .Government' .: 2207 

Greek, classical 1110 

Guidance, education 0826 

Heatlh cnre administration 1202 

Health education 0837 

HeiiUh professions, general 1201 

Hebrew _.1111 

Helping services fl04 

Higher education, general 0805 

Histology 0413 

History « 2205 

History of education 0821 

Honie decoration ^ 1302 

Home economics, general ^...1301 

HonK equipment 1302 

Home management 130-1 

Horticulture >..O108 

Hospilal administration 1202 

Hotel management 0508 

Humanities and social sciences (interdisciplinary) 4903 

Husbandry, animal 0104 

Husbandry, dairy 0105 

Ichthyology 0499 

India studies 0303 

Indian (Asiatic) 1113 

Indtistiial arts education 0839 

Industrial engineering 0913 

Industrial psychology 2008 

Industri'd relations 0516 

liiroinuitiofi sciences 0702 

Information sciences, general 0701 

Inloinialion sy.stenis 0702 

liuiiganie cheinistiy VH)6 

Insliiutional ntanagentcnt 1307 

Inst Miction 082»> 

Insurance 0512 

Intel ior decoration 1009 

Interior design 0203 

Inlernational business 0.M3 

International public service 2106 

Inlernational relations 2210 

Invest men IS 0505 

Islamic studies 0306 

Italian 1104 
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Mpancse 1108 

J«i^*c)ry 1009 

JcJi:iali*m 0602 

Jiinicr college education 0806 

Junior high school ediicainn 0804 

K* lergnrlen education 0823 

Kokean 1199 

Labor relations 0515 

Landscape architecture 0204 

Latin H09 

Latin A nerican studies 0308 

Law enforcement 2105 

Law, pe leral 1401 

Learnin( theory 0822 

Liberal nrts and sciences (interdisciplinary) 4901 

Library - cience, general 1601 

iimnolo iy 0499 

Linguist} ;s , 1505 

Litcratut^. comparative 1503 

Literatur:. English 1502 

Managci icnt, business 0506 

Nfanagencnt, engineering 0913 

Nfarine Mology „ 0418 

Nfarine engineering ,-...0923 

Marketing 0509 

Nfaterinls engineering 0915 

Mathematics, applied , 1703 

Mathem.itics, education 0833 

Mathematics, general 1701 

Mathematics, statistics 1702 

Mechanical engineering 0910 

Medical laboratory technologies ..1223 

Medical record librarianship 12 1 5 

Medical specialties ^1207 

Medicine. M.D. degree 1206 

Metallurgical engineering 0914 

Metallurgy 1920 

Metalsmithing 1009 

Meteorology 1913 

Mexican-American cultural studies 2213 

Microbiology 0411 

Middle L.islcrn studies 0309 

.Military science 1801 

Mineral engineering 0918 

Mining engineering 0918 

Molcaiirr biology .'.0416 * 

Molccul.'-r physics 1903 

Music (hhcral arts program) 1005 

Music nnprcciation 1006 

Music, t«»inp()sition 1004 

Music education 0832 

Music hislory 1006 

Music, pci forming , 1004 

Music, ihcory 1004 

Miisicniogy 1006 

Natural resources management 0115 

Naval architecture 0923 

Nava5 science 1802 

Neurosciences 0425 

Norvegian 1114 

Nuclear engineering 0920 



Nuclear physics 1904 

Nursery science 0109 

Nursing (baccalaureate and higher programs) 1203 

Nutrition, scientific 0424 

Occupational therapy 1208 

Occnn engineering 0924 

Oceanography 1919 

Operations research 0507 

Optometry 1209 

Organic chemistry 1007 

Ornamental horticulture 0109 

Ornithology 04</9 

Osteopathic medicine, D.O. degree 1210 

Pacific area studies ;. 0314 

Painting .*. .'.V. .' i002 

Paltfonlology 1918 

Parasitology 0499 

Park management f. 2103 

Pathology, nnimal .^......0408 

Pathology, human ; .0408 

Pathology, plant 0404 

PcrsonnoJ management ; 0515 

Petroleum engineering'* : : 0907 

Petroleum refining 7. 0906 

Pharmaceutical chemistry 1910 

Pharmacology, animal 0409 

Phfarmacology, human 0409 

Pnarmacology, plant ...0405 

Pharmacy 1211 

Philology : 1505 

Philosophy 1509 

Philosophy of education 0821 

*-. Phonetics : :S05 

Photography ; lOll 

Physical chemistry i908 

Physical education 0835 

Physical sciences, general 1901 

Physical therapy : *2I2 

Physics, gencrnl 1902 

Physiological psychology 2010 

Physiology, animal 0410 

Physiology, hunfian 0410 

Physiology, plant 0406 

Plant pathology 0404 

Plant pharmncology 0405 

Plant physiology 0406 

Podiatry ....1216 

• ' Political science \\\ 2207 

Poultry science ni06 

Pie-elcmcniaiy ciliication ()M23 

Progr.uiiining, computer UliU 

Psyclmlo>»y, clinic.il , 2n()^ 

Psychology for counseling 2004 

Psychology, developmental 2009 

Psycholotiy, education 0822 

Psychology, gcnernl 2001 

Psycholo^tv; industrial 200,S 

Psychology, physiological 2010 

Psychology, social 200S 

Psychomctncs 2006 

Public address 1506 

Public administration 2102 

Public health 1214 

Public utilities 0510 

Purchasing 0509 
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R.ulto 0603 

U,uli(»!>i»»loj:y 0423 

U.ulioloi'ic Icchnolopics 1225 

K;ingc mil II II gc men t 0117 

KciJing cJiicaiion 0K30 

Real estate 05 il 

Kecreiition management -...2103 

Regional planning 0206 

Rehabilitation services 1222 

Religious ediicntion 2304 

Religious music 2302 

Relicious suidies 1510 

Remedial education 0817 

Restaurant nmnagcmenl 0508 

Rhetoric 1506 

Russian 1106 

Uussinn studies 0307 

Safely education 0836 

Sanitary' engineering 0922 

Sanaril 1199 

Scandinavian languages 1114 

Science education «.....0834 

Sculpture .'. 1002 

Secondary education, general « 0803 

Secrcuirial studies „...05I4 

Securities a 0505 

Seii^mology 1916 

Semantics 1505 

Slavic languages (other than Russian) 1115 

Slavic studies ^ 0307 

Social foundations of education 0821 

Social sciences, general » «.2201 

Social psycliOlogy 2005 

Social work 2104 

Sociology „.2208 

Soil conservation „....0103 

Soil management 0103 

Soil science 0103 

South Asian studies 03f^3 

Southeast Asian studies 0304 

Spanish «...1105 

Special education, general 0808 

Special learning disabilities 0818 

Speech 1506 

Speech correction 08 1 5 

Speech pathology 1220 

Statistics, niatheniatical and theoretical 1702 

Statistics in psychology 2007 

Student personnel 0826 

Swedish 1114 

Systems analysis 0705 

Systems, infoiniation 0702 

Teaching of Fnglisli as a foreign language 1508 

Technical education 0839 

Television 0603 

Textile design _.1009 

Textile engineering 0917 

Textiles, home economics 1303 

Theological professions, general 2301 

Toxicology 0426 

Transportation - « 0510 

Transportation engineering ^ ^..0908 



UOM»n architctluic 0205 

Urban studies 2214 

VcKCtablc production 0108 

Veterinary medicine, D.V.M. degree I2IB 

Veterinary medicine specialties - 1219 

Vietnamese 1199 

Vocational education .....0839 

Weaving 1009 

West European studies ....0312 

Wildlife management 0107 

Writing, creative 1507 



Zoology, general ......... 0407 

Part II:' 

te'chnological and occupational cur- 
riculums leading to associate degrees 
and other awards below the 
baccalaureate 

Title Code 

Accounting technologies 5002 

Advertising design tec)inologies 5012 

Advertising technologies .....5004 

Aeronautical technologies 5302 

Agriculture technologies 5402 

Air conditioning technologies 5317 

Airport management technologies 5004 

Animal laboratory assistant technologies 5206 

Appliance repair technologies 5310 

Applied arts technologies 5012 

Architectural drafting technologies 5304 

Automotive technologies 5306 

Aviation technologies 5302 

Banking technologies 5003 

Bible study 5502 

Biological labointory assistant technologies 5205 

Broadcasting technologies 50^8 

Uuilding technologies 5317 

Business management technologies — 5004 

Business technologies, geneial 5001 

Carpentry technologies' 5317 

Chemical technologies 5305 

Civil tcchnoloj!ics '^^O'^ 

Commerce technologies, general 5001 

Communications technologies — 500K 

Computer operator technologifs 5104 

Computer, peripheral equipment 

operation technologies 5104 

Computer programmer technologies 5103 

Construction technologies 5317 

Corrections technologies 5305 

Cosmetologist 5006 
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D«itR processing equipment 

mnintcnnncc technologies 5105 

Data processing technologies, general 5101 

Denial assistant technologies 5202 

Denial hygiene technologies 5203 

Dental laboratory technologies 5204 

Diesel technologies 5307 

Distrihiition technologies 5004 

Drafting, architectiirRl 5304 

Education technologies 5503 

Elcctiician technologies 5317 

Electio diagnostic technologies 5217 

Electromechanical technologies 5311 

Electronics and machine technologies 5310 

Engineering graphics 5303 

Engineering technologies, general 5301 

Environmcnial hi^allh technologies 5408 

Finance technologies 5003 

Fine arts technologies , 5012 

Fire control technology 5507 

Fisheries technologies 5403 

Food services technologies 5404 

Forestry technologies 5403 

Graphic arts technologies 5012 

Health .services assistant technologies, general 5201 

Healing technologies 5317 

Home economics technologies 5405 

Horticiilliirc technologies 5402 

Hospital food service technologies 5404 

Hotel management technologies 5010 

Industrial management technologies 5004 

Industrial technologies 5312 

Inhnlation therapy technologies 5215 

Input preparation technologies 5102 

Institutional management technologies 5218 

Instrumcnlnlion technologies 5314 

Insurijncc technologies 5004 

Key punch operator technologies 5102 

Laboratory technologies, general 5407 

Landscape technologies 5402 

Law enforcement technologies 5505 

l.ihr.iiy asMsinni technologies ^ 5504 

I ilhonfiiphy U'clinolofiics . 5000 

M.ii.tiiiK- tli.ifiinr' and drsij'ii lirchnologics 5M)^ 

M.uhtiK' up. Ill Iri liDolufKA S1M» 

M.iiiii.i cttttipincnl lctliiioln)Mcs 51)01 

NLirinc Icchnolonics 

Marketing lethnoli)g»c*» 5004 

Mcih:inii«il lccliii()l(»f»rs 5315 

Mcih.inic.il IcthnoloKK's. general 5301 

Medit.il :i\si\lant technologies _ 5214 

Mcdic.il l.iboi;ilory assistant technologies 5205 

Mcdicil office assistant technologies 5214 

Medical recoid technologies 5213 

Mental health aide programs 5216 



Natural science technologies, general 5401 

Newspaper communication technologies 5008 

Nuclear technologies 5316 

Nursing, practical (L.P.N, or L.V.N.) 5209 

Nursing K.N. preparation 5208 

Occupational therapy technologies 5210 

Oceanographic technologies 5406 

Ocular care technologies 5212 

Office machine repair technologies ... 5110 

OfTice machine training 5005 

Ophthalmic technologies 5212 

Optical technologies 5212 

Oplomelric technologies 5212 

Personal service technologies 5006 

Personnel management technologies j.5004 

Photograiiimelry technologies * 5309 

Photography technologies .^007 

Physical therapy technology 5219 

Plastics technologies 5305 

Plumbing technologies 5317 

Police technologies 5505 

Printing technologies 5009 

Programmer technologies 5103 « 

Psychiatric technologies 5216 

Public administration and management technologies ....5508 

Public health inspection technologies 5408 

Public service technologies, general 5501 

Public utility technologies 5011 

Purchasing technologies 5004 

Radio broadcasting technologies 5008 

Radio repair technologies 5310 

Radiologic technologies 5207 

Real estate technologies 5004 

Recreation technologies 5506 

Religion related occupations 5502 

Rest home management technology 5218 

Restaurant management technologies 5010 

Sales technologies 5004 

Sanitation technologies 5408 

Seerctarinl technologies 5005 

Sheet metal technologies 5317 

Social work related technologies 5506 

Stewardess preparation ^ 5006 

Surgical technologies 5211 

Surveying technologies 5309 

*rc;iclK*i aitle piop.iMilinn 5503 

'IVIcviMon Iwo.iili aMini* IcclinologieH 500S 

icIcviMoii icp.iii lc-chnolo(.'ic* . . '310 

Texlile Icchnnlo/^ics 531.1 

Tool design technologies , 5103 

'Iransporlation technologies 5011 

Welding technologies 5308 

Wildlife technologies 5403 

X'fiy technologies 5207 
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